Peng CHENG

Principal Researcher, Microsoft Research

Joined

May 2022

Names

Peng CHENG (Preferred)

Emails

****@microsoft.com (Confirmed)

Personal Links

Homepage

Google Scholar

Career & Education History

Principal Researcher

Microsoft Research (microsoft.com)

2024 – Present

Principal Researcher

Microsoft Research (microsoft.com)

2015 – 2024

Advisors, Relations & Conflicts

PhD Advisor

Fengyuan Ren

2010 – 2015

Expertise

No areas of expertise listed

Publications

Retrieval as Reasoning: Learning to Select and Generate with LLMs
Qiwei Di, Yuhang He, Qi Chen, Quanquan Gu, Peng CHENG, Jing Bai
- Submitted to ICLR 2026
- Readers: Everyone
Learning from the Best, Differently: A Diversity-Driven Rethinking on Data Selection
Hongyi He, Xiao Liu, Zhenghao Lin, Mingni Tang, Yi Cheng, Jintao Wang, Wenjie Li, Yeyun Gong, Peng CHENG
- Submitted to ICLR 2026
- Readers: Everyone
Recycling Pretrained Checkpoints: Orthogonal Growth of Mixture-of-Experts for Efficient Large Language Model Pre-Training
Ruizhe Wang, Yucheng Ding, Xiao Liu, Yaoxiang Wang, Yeyun Gong, Peng CHENG, Baining Guo, Zheng-Jun Zha
- Submitted to ICLR 2026
- Readers: Everyone
Training Matryoshka Mixture-of-Experts for Elastic Inference-Time Expert Utilization
Yaoxiang Wang, Qingguo Hu, Yucheng Ding, Ruizhe Wang, Yeyun Gong, Jian Jiao, yelong shen, Peng CHENG, Jinsong Su
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
Optimizing Large Language Model Training Using FP4 Quantization
Ruizhe Wang, Yeyun Gong, Xiao Liu, Guoshuai Zhao, Ziyue Yang, Baining Guo, Zheng-Jun Zha, Peng CHENG
- ICML 2025 poster
- Readers: Everyone
Integrative Decoding: Improving Factuality via Implicit Self-consistency
Yi Cheng, Xiao Liang, Yeyun Gong, Wen Xiao, Song Wang, Yuji Zhang, Wenjun Hou, Kaishuai Xu, Wenge Liu, Wenjie Li, Jian Jiao, Qi Chen, Peng CHENG, Wayne Xiong
- ICLR 2025 Poster
- Readers: Everyone
Automated Proof Generation for Rust Code via Self-Evolution
Tianyu Chen, Shuai Lu, Shan Lu, Yeyun Gong, Chenyuan Yang, Xuheng Li, Md Rakib Hossain Misu, Hao Yu, Nan Duan, Peng CHENG, Fan Yang, Shuvendu K Lahiri, Tao Xie, Lidong Zhou
- ICLR 2025 Poster
- Readers: Everyone
An Adaptive Deep RL Method for Non-Stationary Environments with Piecewise Stable Context
Xiaoyu Chen, Xiangming Zhu, Yufeng Zheng, Pushi Zhang, Li Zhao, Wenxue Cheng, Peng CHENG, Yongqiang Xiong, Tao Qin, Jianyu Chen, Tie-Yan Liu
- Published: 31 Oct 2022, Last Modified: 08 Feb 2026
- NeurIPS 2022 Accept
- Readers: Everyone

Co-Authors

View all 54 co-authors