Rui Hou

Research Scientist, Meta Inc.

Joined

September 2019

Names

Rui Hou (Preferred)

Emails

****@umich.edu (Confirmed)

****@tri.global (Confirmed)

****@fb.com (Confirmed)

****@meta.com (Confirmed)

Personal Links

Career & Education History

Research Scientist

Meta Inc. (meta.inc)

2020 – Present

PhD student

Computer Science, University of Michigan, Ann Arbor (umich.edu)

2014 – 2020

Advisors, Relations & Conflicts

Coworker

Madian Khabsa

2020 – 2023

PhD Advisor

Jerome P. Lynch

2014 – 2020

Expertise

Large Language Model

2022 – 2023

Multi-modal representation

2020 – 2022

Publications

High Accuracy, Less Talk (HALT): Reliable LLMs through Capability-Aligned Finetuning
Tim Franzmeyer, Archie Sravankumar, Lijuan Liu, Yuning Mao, Rui Hou, Sinong Wang, Jakob Nicolaus Foerster, Luke Zettlemoyer, Madian Khabsa
- ICLR 2026 Poster
- Readers: Everyone
Layer Swapping for Zero-Shot Cross-Lingual Transfer in Large Language Models
Lucas Bandarkar, Benjamin Muller, Pritish Yuvraj, Rui Hou, Nayan Singhal, Hongjiang Lv, Bing Liu
- ICLR 2025 Spotlight
- Readers: Everyone
Law of the Weakest Link: Cross Capabilities of Large Language Models
Ming Zhong, Aston Zhang, Xuewei Wang, Rui Hou, Wenhan Xiong, Chenguang Zhu, Zhengxing Chen, Liang Tan, Chloe Bi, Mike Lewis, Sravya Popuri, Sharan Narang, Melanie Kambadur, Dhruv Mahajan, Sergey Edunov, Jiawei Han, Laurens van der Maaten
- ICLR 2025 Poster
- Readers: Everyone
Effective Long-Context Scaling of Foundation Models
Jingyu Liu, Wenhan Xiong, Igor Molybog, Hejia Zhang, Prajjwal Bhargava, Rui Hou, Louis Martin, Rashi Rungta, Karthik Abinav Sankararaman, Barlas Oguz, Madian Khabsa, Han Fang, Yashar Mehdad, Sharan Narang, Kshitiz Malik, Angela Fan, Shruti Bhosale, Sergey Edunov, Mike Lewis, Sinong Wang et al. (1 additional authors not shown)
- NAACL 2024
- Readers: Everyone
Learning Easily Updated General Purpose Text Representations with Adaptable Task-Specific Prefix
Kuan-Hao Huang, Liang Tan, Rui Hou, Sinong Wang, Amjad Almahairi, Ruty Rinott
- EMNLP 2023 Findings
- Readers: Everyone
RoAST: Robustifying Language Models via Adversarial Perturbation with Selective Training
Jaehyung Kim, Yuning Mao, Rui Hou, Hanchao Yu, Davis Liang, Pascale Fung, Qifan Wang, Fuli Feng, Lifu Huang, Madian Khabsa
- EMNLP 2023 Findings
- Readers: Everyone
XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models
Davis Liang, Hila Gonen, Yuning Mao, Rui Hou, Naman Goyal, Marjan Ghazvininejad, Luke Zettlemoyer, Madian Khabsa
- EMNLP 2023 Main
- Readers: Everyone
Co-training and Co-distillation for Quality Improvement and Compression of Language Models
Hayeon Lee, Rui Hou, Jongpil Kim, Davis Liang, Hongbo Zhang, Sung Ju Hwang, Alexander Min
- EMNLP 2023 Findings
- Readers: Everyone
Progressive Prompts: Continual Learning for Language Models
Anastasia Razdaibiedina, Yuning Mao, Rui Hou, Madian Khabsa, Mike Lewis, Amjad Almahairi
- Published: 01 Feb 2023, Last Modified: 14 Jan 2026
- ICLR 2023 poster
- Readers: Everyone
Robustifying Language Models via Adversarial Training with Masked Gradient
Jaehyung Kim, Yuning Mao, Rui Hou, Hanchao Yu, Davis Liang, Pascale Fung, Qifan Wang, Madian Khabsa
- 22 Sept 2022 (modified: 13 Feb 2023)
- ICLR 2023 Conference Withdrawn Submission
- Readers: Everyone

Co-Authors

View all 63 co-authors