Hongyu Gong

Researcher, FAIR at Meta

Joined

November 2016

Names

Hongyu Gong (Preferred)

Emails

****@illinois.edu (Confirmed)

****@gmail.com (Confirmed)

Personal Links

Career & Education History

Researcher

FAIR at Meta (meta.com)

2020 – Present

Researcher

Facebook (fb.com)

2020 – 2022

PhD student

University of Illinois, Urbana Champaign (illinois.edu)

2017 – 2020

MS student

University of Illinois, Urbana Champaign (illinois.edu)

2015 – 2017

Advisors, Relations & Conflicts

PhD Advisor

Suma Bhat

2015 – 2020

PhD Advisor

Pramod Viswanath

2015 – 2020

Expertise

Audiovisual Modeling

2024 – Present

Speech

2020 – Present

Natural Language Processing

2015 – Present

Publications

Joint speech and text machine translation for up to 100 languages
Kaushik Ram Sadagopan, Loic Barrault, Maha Elbayad, David Dale, Ning Dong, Yu-An Chung, Sravya Popuri, Marta R. Costa-jussà, Holger Schwenk, Changhan Wang, Peng-Jen Chen, Yilin Yang, Anna Sun, Hirofumi Inaguma, Francisco Guzmán, Ann Lee, Alexandre Mourachko, Kevin Heffernan, Hady Elsahar, Hongyu Gong et al. (2 additional authors not shown)
- Nature, 2025
- Readers: Everyone
DC-Spin: A Speaker-invariant Speech Tokenizer For Spoken Language Models
Heng-Jui Chang, Hongyu Gong, Changhan Wang, James R. Glass, Yu-An Chung
- Submitted to ICLR 2025
- Readers: Everyone
Enhancing Language Models with Idiomatic Reasoning
Jianing Zhou, Ziheng Zeng, Hongyu Gong, Suma Bhat
- COLM
- Readers: Everyone
SeamlessM4T: Massively Multilingual & Multimodal Machine Translation
Loic Barrault, Yu-An Chung, David Dale, Ning Dong, Paul-Ambroise Duquenne, Hady Elsahar, Hongyu Gong, Kevin Heffernan, Jean Maillard, Guillaume Wenzek, Peng-Jen Chen, Ilia Kulikov, Min-Jae Hwang, Hirofumi Inaguma, Xutai Ma, Anna Sun, Pierre Andrews, Marta R. Costa-jussà, Onur Çelebi, Kaushik Ram Sadagopan et al. (9 additional authors not shown)
- 08 Dec 2023 (modified: 28 May 2024)
- OpenReview Archive Direct Upload
- Readers: Everyone
Non-compositional Expression Generation Based on Curriculum Learning and Continual Learning
Jianing Zhou, Ziheng Zeng, Hongyu Gong, Suma Bhat
- EMNLP 2023 Findings
- Readers: Everyone
Pre-training for Speech Translation: CTC Meets Optimal Transport
Phuong-Hang Le, Hongyu Gong, Changhan Wang, Juan Pino, Benjamin Lecouteux, Didier Schwab
- ICML 2023 OralPoster
- Readers: Everyone
A Holistic Cascade System, benchmark, and Human Evaluation Protocol for Expressive Speech-to-Speech Translation
Wen-Chin Huang, Benjamin Peloquin, Justine Kao, Changhan Wang, Hongyu Gong, Elizabeth Salesky, Yossi Adi, Ann Lee, Peng-Jen Chen
- 2023 (modified: 16 Apr 2023)
- CoRR 2023
- Readers: Everyone
Pre-training for Speech Translation: CTC Meets Optimal Transport
Phuong-Hang Le, Hongyu Gong, Changhan Wang, Juan Pino, Benjamin Lecouteux, Didier Schwab
- 2023 (modified: 16 Apr 2023)
- CoRR 2023
- Readers: Everyone
Findings of the IWSLT 2022 Evaluation Campaign
Antonios Anastasopoulos, Loïc Barrault, Luisa Bentivogli, Marcely Zanon Boito, Ondrej Bojar, Roldano Cattoni, Anna Currey, Georgiana Dinu, Kevin Duh, Maha Elbayad, Clara Emmanuel, Yannick Estève, Marcello Federico, Christian Federmann, Souhir Gahbiche, Hongyu Gong, Roman Grundkiewicz, Barry Haddow, Benjamin Hsu, Dávid Javorský et al. (23 additional authors not shown)
- 2022 (modified: 04 Oct 2022)
- IWSLT@ACL 2022
- Readers: Everyone
Textless Speech-to-Speech Translation on Real Data
Ann Lee, Hongyu Gong, Paul-Ambroise Duquenne, Holger Schwenk, Peng-Jen Chen, Changhan Wang, Sravya Popuri, Yossi Adi, Juan Pino, Jiatao Gu, Wei-Ning Hsu
- 2022 (modified: 19 Dec 2022)
- NAACL-HLT 2022
- Readers: Everyone

View all 68 publications

Co-Authors

View all 140 co-authors