Hongyu Gong
RESEARCH SCIENTIST | SEATTLE, UNITED STATES
Hongyu is a research scientist at Facebook AI Research with a focus on speech and text translation. Her research interests span the areas of language representation learning and language generation, and her research has been published in top-tier NLP venues including ACL and EMNLP. She obtained her PhD from the University of Illinois at Urbana-Champaign in 2020
Research Areas
Hongyu's Work
Hongyu's Publications
June 27, 2025
HUMAN & MACHINE INTELLIGENCE
CONVERSATIONAL AI
Seamless Interaction: Dyadic Audiovisual Motion Modeling and Large-Scale Dataset
Morteza Behrooz, Ning Dong, Jeff Girard, Vasu Sharma, Jan Zikes, Akinniyi Akinyemi, Alex Shcherbyna, Alexander Richard, Alice Rakotoarison, Amia Oberai, Anastasis Stathopoulos, Anna Sun, Antony D'Avirro, Arina Turkatenko, Benjamin Peloquin, Bo Wan, Brandon Han, Carleigh Wood, Chao Wang, Chen Zhang, Christophe Ropers, Christopher Klaiber, Cynthia Gao, Dejan Kovachev, Denise Hernandez, Evonne Ng, Fabian Prada, Fabio Maria Carlucci, Guangyao Ma, Hang Li, Hirofumi Inaguma, Hongyu Gong, Jason Zheng, Jeff Wang, Jie Shen, Jiemin Zhang, Jing Ma, Joe Chuang, Jon Daly, Jovan Popovic, Joy Chen, Juan Pino, Julia Buffalini, Zhiyuan Yao, Junming Chen, Kam-Woh Ng, Kathryn Alvero, Louis-Philippe Morency, Lucas Mantovani, Mark Duppenthaler, Martin Gleize, Martin Ma, Mary Williamson, Michael Zollhoefer, Moneish Kumar, Omid Poursaeed, Paden Tomasello, Pavel Litvin, Pavlo Zhyzheria, Praveen Chowdary, Qingyao Jia, Raj Janardhan, Rongjie Huang, Safiyyah Saleem, Sagar Miglani, Sahir Gomez, Sen He, Shiyang Cheng, Somya Jain, Sreyas Mohan, Srivathsan Govindarajan, Tao Xiang, Tu Anh Nguyen, Tuan Tran, Vasu Agrawal, Wei Liu, Xinyue Zhang, Xutai Ma, Yilei Li, Yilin Yang, Yordan Hristov, Zhang Chen
June 27, 2025
October 04, 2024
HUMAN & MACHINE INTELLIGENCE
CONVERSATIONAL AI
Beyond Turn-Based Interfaces: Synchronous LLMs as Full-Duplex Dialogue Agents
Shyam Gollakota, Hongyu Gong, Bandhav Veluri, Benjamin Peloquin, Bokai Yu
October 04, 2024
June 25, 2024
SPEECH & AUDIO
NLP
Textless Acoustic Model with Self-Supervised Distillation for Noise-Robust Expressive Speech-to-Speech Translation
Min-Jae Hwang, Ann Lee, Benjamin Peloquin, Hongyu Gong, Ilia Kulikov, Peng-Jen Chen
June 25, 2024
November 30, 2023
SPEECH & AUDIO
NLP
Seamless: Multilingual Expressive and Streaming Speech Translation
Seamless Communication, Elahe Kalbassi, Xutai Ma, Abinesh Ramakrishnan, Alexandre Mourachko, Alice Rakotoarison, Amanda Kallet, Yu-An Chung, Ann Lee, Anna Sun, Artyom Kozhevnikov, Benjamin Peloquin, Bokai Yu, Brian Ellis, Can Balioglu, Carleigh Wood, Changhan Wang, Christophe Ropers, Christophe Touret, Christopher Klaiber, Corinne Wong, Cynthia Gao, Daniel Licht, David Dale, Ethan Ye, Gabriel Mejia Gonzalez, Guillaume Wenzek, Hady Elsahar, Hirofumi Inaguma, Holger Schwenk, Hongyu Gong, Ilia Kulikov, Ivan Evtimov, Jean Maillard, Jeff Wang, John Hoffman, Juan Pino, Justin Haaheim, Justine Kao, Prangthip Hansanti, Kaushik Ram Sadagopan, Kevin Heffernan, Loïc Barrault, Maha Elbayad, Mariano Coria Meglioli, Mark Duppenthaler, Marta R. Costa-jussà, Mary Williamson, Min-Jae Hwang, Ning Dong, Francisco Guzmán, Paden Tomasello, Paul-Ambroise Duquenne, Peng-Jen Chen, Pengwei Li, Pierre Andrews, Pierre Fernandez, Robin San Roman, Ruslan Mavlyutov, Safiyyah Saleem, Skyler Wang, Somya Jain, Sravya Popuri, Tuan Tran, Yilin Yang
November 30, 2023
August 22, 2023
SPEECH & AUDIO
NLP
SeamlessM4T—Massively Multilingual & Multimodal Machine Translation
Seamless Communication, Safiyyah Saleem, Abinesh Ramakrishnan, Alexandre Mourachko, Alice Rakotoarison, Amanda Kallet, Andy Chung, Ann Lee, Anna Sun, Bapi Akula, Benjamin Peloquin, Bernie Huang, Bokai Yu, Brian Ellis, Can Balioglu, Carleigh Wood, Changhan Wang, Christophe Ropers, Christopher Klaiber, Cynthia Gao, Daniel Li (FAIR), Daniel Licht, David Dale, Elahe Kalbassi, Ethan Ye, Gabriel Mejia Gonzalez, Guillaume Wenzek, Hady Elsahar, Hirofumi Inaguma, Holger Schwenk, Hongyu Gong, Igor Tufanov, Ilia Kulikov, Janice Lam, Jean Maillard, Jeff Wang (PM - AI), John Hoffman, Juan Pino, Justin Haaheim, Justine Kao, Prangthip Hasanti, Kaushik Ram Sadagopan, Kevin Heffernan, Kevin Tran, Loic Barrault, Maha Elbayad, Marta R. Costa-jussa, Mohamed Ramadan, Naji El Hachem, Ning Dong (AI), Onur Çelebi, Paco Guzmán, Paden Tomasello, Paul-Ambroise Duquenne, Peng-Jen Chen, Pengwei Li, Pierre Andrews, Ruslan Mavlyutov, Russ Howes, Skyler Wang, Somya Jain, Sravya Popuri, Tuan Tran, Vish Vogeti, Xutai Ma, Yilin Yang
August 22, 2023
February 06, 2022
RESEARCH
Multimodal and Multilingual Embeddings for Large-Scale Speech Mining
Holger Schwenk, Hongyu Gong, Paul-Ambroise Duquenne
February 06, 2022
December 06, 2021
NLP
Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modeling
Hongyu Gong, Juan Pino, Xian Li, Yun Tang
December 06, 2021
Our approach
Latest news
Foundational models
Meta © 2026