Lihong Li

AI Research Scientist, Facebook

Joined

September 2016

Names

Lihong Li (Preferred)

Emails

****@gmail.com (Confirmed)

****@amazon.com (Confirmed)

****@meta.com (Confirmed)

Personal Links

Career & Education History

AI Research Scientist

Facebook (meta.com)

2025 – Present

Senior Principal Scientist

Amazon (amazon.com)

2020 – 2025

Research Scientist

Google (google.com)

2017 – 2020

Senior Principal Researcher

Microsoft (microsoft.com)

2012 – 2017

Research Scientist

Yahoo (yahoo-inc.com)

2009 – 2012

PhD student

Rutgers University (rutgers.edu)

2005 – 2009

Advisors, Relations & Conflicts

PhD Advisor

Michael Littman

2005 – 2009

Expertise

large language models

2024 – Present

conversational systems

2017 – Present

contextual bandit

2010 – Present

reinforcement learning

2005 – Present

Publications

MESOB: Balancing Equilibria & Social Optimality
Xin Guo, Lihong Li, Sareh Nabi, Rabih Salhab, Junzi Zhang
- KDD 2023 Workshop on Multi-Armed Bandits and Reinforcement Learning
- Readers: Everyone
Improving Sampling Efficiency in RLVR through Adaptive Rollout and Response Reuse
Yuheng Zhang, Wenlin Yao, Changlong Yu, Yao Liu, Qingyu Yin, Bing Yin, Hyokun Yun, Lihong Li
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
SFT Doesn’t Always Hurt General Capabilities: Revisiting Domain-Specific Fine-Tuning in LLMs
Jiacheng Lin, Zhongruo Wang, Kun Qian, Tian Wang, Arvind Srinivasan, Hansi Zeng, Ruochen Jiao, Xie Zhou, Jiri Gesi, Dakuo Wang, Yufan Guo, Kai Zhong, Weiqi Zhang, sujay sanghavi, Changyou Chen, Hyokun Yun, Lihong Li
- ICLR 2026 Poster
- Readers: Everyone
WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learning
Zhepei Wei, Wenlin Yao, Yao Liu, Weizhi Zhang, Qin Lu, Liang Qiu, Changlong Yu, Puyang Xu, Chao Zhang, Bing Yin, Hyokun Yun, Lihong Li
- WCUA 2025 Poster
- Readers: Everyone
Ask a Strong LLM Judge when Your Reward Model is Uncertain
Zhenghao Xu, Qin Lu, Qingru Zhang, Liang Qiu, Ilgee Hong, Changlong Yu, Wenlin Yao, Yao Liu, Haoming Jiang, Lihong Li, Hyokun Yun, Tuo Zhao
- NeurIPS 2025 poster
- Readers: Everyone
Self-Rewarding PPO: Aligning Large Language Models with Demonstrations Only
Qingru Zhang, Liang Qiu, Ilgee Hong, Zhenghao Xu, Tianyi Liu, Shiyang Li, Rongzhi Zhang, Zheng Li, Lihong Li, Bing Yin, Chao Zhang, Jianshu Chen, Haoming Jiang, Tuo Zhao
- COLM 2025
- Readers: Everyone
A Reinforcement Learning Approach to Estimating Long-term Treatment Effects
Ziyang Tang, Yiheng Duan, Stephanie Zhang, Lihong Li
- Published: 01 Feb 2023, Last Modified: 14 Jan 2026
- Submitted to ICLR 2023
- Readers: Everyone
Understanding Domain Randomization for Sim-to-real Transfer
Xiaoyu Chen, Jiachen Hu, Chi Jin, Lihong Li, Liwei Wang
- Published: 28 Jan 2022, Last Modified: 13 Feb 2023
- ICLR 2022 Spotlight
- Readers: Everyone
On the Optimality of Batch Policy Optimization Algorithms
Chenjun Xiao, Yifan Wu, Tor Lattimore, Bo Dai, Jincheng Mei, Lihong Li, Csaba Szepesvari, Dale Schuurmans
- 10 May 2021
- OpenReview Archive Direct Upload
- Readers: Everyone
Offline Policy Optimization with Variance Regularization
Riashat Islam, Samarth Sinha, Homanga Bharadhwaj, Samin Yeasar Arnob, Zhuoran Yang, Zhaoran Wang, Animesh Garg, Lihong Li, Doina Precup
- 28 Sept 2020 (modified: 05 May 2023)
- ICLR 2021 Conference Blind Submission
- Readers: Everyone

View all 148 publications

Co-Authors

View all 209 co-authors