Zhiheng Xi

PhD student, Fudan University

Joined

September 2022

Names

Zhiheng Xi (Preferred)

Emails

****@m.fudan.edu.cn (Confirmed)

Personal Links

Career & Education History

PhD student

Fudan University (fudan.edu.cn)

2022 – 2027

Undergrad student

Nanjing University (nju.edu.cn)

2018 – 2022

Advisors, Relations & Conflicts

PhD Advisor

Xuanjing Huang

2022 – 2027

PhD Advisor

Qi Zhang

2022 – 2027

PhD Advisor

Tao Gui

2022 – 2027

Expertise

Large Language Models

2022 – 2025

LLM Reasoning

2022 – 2025

LLM Agent

2022 – 2025

LLM RL

2022 – 2025

Publications

AgentGym-RL: An Open-Source Framework to Train LLM Agents for Long-Horizon Decision Making via Multi-Turn RL
Zhiheng Xi, Jixuan Huang, Chenyang Liao, Baodai Huang, Jiaqi Liu, Honglin Guo, yajie yang, Rui Zheng, Junjie Ye, Jiazheng Zhang, Wenxiang Chen, Wei He, Yiwen Ding, Guanyu Li, Zehui Chen, Zhengyin Du, Xuesong Yao, Yufei Xu, Jiecao Chen, Tao Gui et al. (4 additional authors not shown)
- LLA 2026 Poster
- Readers: Everyone
BAPO: Stabilizing Off-Policy Reinforcement Learning for LLMs via Balanced Policy Optimization with Adaptive Clipping
Zhiheng Xi, Xin Guo, Yang Nan, Enyu Zhou, Junrui Shen, Wenxiang Chen, Jiaqi Liu, Jixuan Huang, Xun Deng, Zhihao Zhang, Honglin Guo, Zhikai Lei, Miao Zheng, Guoteng Wang, Peng Sun, Rui Zheng, Hang Yan, Tao Gui, Qi Zhang, Xuanjing Huang
- ICLR 2026 Poster
- Readers: Everyone
Critique-RL: Training Language Models For Critiquing Through Two-Stage Reinforcement Learning
Zhiheng Xi, Jixuan Huang, Xin Guo, Boyang Hong, Dingwen Yang, Xiaoran Fan, Shuo Li, Zehui Chen, Junjie Ye, Siyu Yuan, Zhengyin Du, Xuesong Yao, Yufei Xu, Jiecao Chen, Rui Zheng, Tao Gui, Qi Zhang, Xuanjing Huang
- ICLR 2026 Poster
- Readers: Everyone
AgentGym-RL: An Open-Source Framework to Train LLM Agents for Long-Horizon Decision Making via Multi-Turn RL
Zhiheng Xi, Jixuan Huang, Chenyang Liao, Baodai Huang, Jiaqi Liu, Honglin Guo, yajie yang, Rui Zheng, Junjie Ye, Jiazheng Zhang, Wenxiang Chen, Wei He, Yiwen Ding, Guanyu Li, Zehui Chen, Zhengyin Du, Xuesong Yao, Yufei Xu, Jiecao Chen, Tao Gui et al. (4 additional authors not shown)
- ICLR 2026 Oral
- Readers: Everyone
Game-RL: Synthesizing Multimodal Verifiable Game Data to Boost VLMs' General Reasoning
Jingqi Tong, Jixin Tang, Hangcheng Li, Yurong Mou, Ming Zhang, Jun Zhao, Yanbo Wen, Fan Song, Jiahao Zhan, Yuyang Lu, Chaoran Tao, Zhiyuan Guo, Jizhou Yu, Tianhao Cheng, Zhiheng Xi, Changhao Jiang, Zhangyue Yin, Yining Zheng, Weifeng Ge, Guanhua Chen et al. (4 additional authors not shown)
- ICLR 2026 Poster
- Readers: Everyone
From Scores to Preferences: Redefining MOS Benchmarking for Speech Quality Reward Modeling
Yifei Cao, Changhao Jiang, Jiabao Zhuang, Jiajun Sun, Ming Zhang, Zhiheng Xi, Hui Li, Shihan Dou, Yuran Wang, Yunke Zhang, Tao Ji, Tao Gui, Qi Zhang, Xuanjing Huang
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
Two Minds Better Than One: Collaborative Reward Modeling for LLM Alignment
Jiazheng Zhang, Wenqing Jing, Zizhuo Zhang, Zhiheng Xi, Shihan Dou, Rongxiang Weng, Jiahuan Li, Jingang Wang, Mingxu Chai, Shibo Hong, Yuming Yang, Xuanjing Huang, Tao Gui, Qi Zhang
- Submitted to ICLR 2026
- Readers: Everyone
Why Reinforcement Fine-Tuning Enables MLLMs Preserve Prior Knowledge Better: A Data Perspective
Zhihao Zhang, Qiaole Dong, Qi Zhang, Enyu Zhou, Jun Zhao, Zhiheng Xi, Senjie Jin, Xiaoran Fan, Yuhao Zhou, Mingqi Wu, Yanwei Fu, Tao Ji, Tao Gui, Xuanjing Huang, Kai Chen
- ICLR 2026 Poster
- Readers: Everyone
Better know nothing than half-know anything: A Precise and Efficient Dataset for Scientific Reasoning in Language Models
Yutao Fan, Yizhou Wang, Zhiheng Xi, Lintao Wang, Jianyu Wu, Aoran Wang, Guanyu Li, Jiaqi Liu, Pengze Li, Heng Zhou, Jiayang Li, Wangmeng Zuo, LEI BAI, SHIXIANG TANG, Philip Torr, Zhenfei Yin
- Submitted to ICLR 2026
- Readers: Everyone
BMMR: A Large-Scale Bilingual Multimodal Multi-Discipline Reasoning Dataset
Zhiheng Xi, Guanyu Li, YuTao Fan, Honglin Guo, Yufang Liu, Xiaoran Fan, Jiaqi Liu, dingjinchao, Wangmeng Zuo, Zhenfei Yin, LEI BAI, Tao Ji, Tao Gui, Qi Zhang, Xuanjing Huang
- NeurIPS 2025 Datasets and Benchmarks Track poster
- Readers: Everyone

View all 68 publications

Co-Authors

View all 193 co-authors