Yeyun Gong

Joined

September 2021

Names

Yeyun Gong (Preferred)

Emails

****@microsoft.com (Confirmed)

Personal Links

Career & Education History

Researcher

Microsoft (microsoft.com)

2017 – 2025

PhD student

Fudan University (fudan.edu.cn)

2012 – 2017

Advisors, Relations & Conflicts

Coworker

Nan Duan

2017 – 2024

PhD Advisor

Xuanjing Huang

2012 – 2017

PhD Advisor

Qi Zhang

2012 – 2017

Expertise

Large Language Model

2023 – 2025

Information Retrieval

2020 – 2021

Natural Language Generation

2018 – 2021

Publications

Beyond Length: Quantifying Long-Range Information for Long-Context LLM Pretraining Data
Haoran Deng, Yingyu Lin, Zhenghao Lin, Xiao Liu, Yizhou Sun, Yian Ma, Yeyun Gong
- ICLR 2026 Poster
- Readers: Everyone
Behind RoPE: How Does Causal Mask Encode Positional Information?
Junu Kim, Xiao Liu, Zhenghao Lin, Lei Ji, Yeyun Gong, Edward Choi
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
Learning from the Best, Differently: A Diversity-Driven Rethinking on Data Selection
Hongyi He, Xiao Liu, Zhenghao Lin, Mingni Tang, Yi Cheng, Jintao Wang, Wenjie Li, Yeyun Gong, Peng CHENG
- Submitted to ICLR 2026
- Readers: Everyone
Recycling Pretrained Checkpoints: Orthogonal Growth of Mixture-of-Experts for Efficient Large Language Model Pre-Training
Ruizhe Wang, Yucheng Ding, Xiao Liu, Yaoxiang Wang, Yeyun Gong, Peng CHENG, Baining Guo, Zheng-Jun Zha
- Submitted to ICLR 2026
- Readers: Everyone
TL;DR: Too Long, Do Re-weighting for Efficient LLM Reasoning Compression
Zhong-Zhi Li, Xiao Liang, Zihao Tang, Lei Ji, Peijie Wang, Haotian Xu, Xing W, Haizhen Huang, Weiwei Deng, Yeyun Gong, Zhijiang Guo, Xiao Liu, Fei Yin, Cheng-Lin Liu
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
Beyond Pass@ 1: Self-Play with Variational Problem Synthesis Sustains RLVR
Xiao Liang, Zhong-Zhi Li, Yeyun Gong, yelong shen, Ying Nian Wu, Zhijiang Guo, Weizhu Chen
- ICLR 2026 Poster
- Readers: Everyone
Training Matryoshka Mixture-of-Experts for Elastic Inference-Time Expert Utilization
Yaoxiang Wang, Qingguo Hu, Yucheng Ding, Ruizhe Wang, Yeyun Gong, Jian Jiao, yelong shen, Peng CHENG, Jinsong Su
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
Mixture of Neuron Experts
Runxi Cheng, Yeyun Gong, Yuchen Guan, Yucheng Ding, Qingguo Hu, Yongxian Wei, Chun Yuan, yelong shen, Weizhu Chen
- Submitted to ICLR 2026
- Readers: Everyone
SwS: Self-aware Weakness-driven Problem Synthesis in Reinforcement Learning for LLM Reasoning
Xiao Liang, Zhong-Zhi Li, Yeyun Gong, Yang Wang, Hengyuan Zhang, yelong shen, Ying Nian Wu, Weizhu Chen
- NeurIPS 2025 poster
- Readers: Everyone
PeRL: Permutation-Enhanced Reinforcement Learning for Interleaved Vision-Language Reasoning
Yizhen Zhang, Yang Ding, Shuoshuo Zhang, Xinchen Zhang, Haoling Li, Zhong-Zhi Li, Peijie Wang, Jie Wu, Lei Ji, Yeyun Gong, yelong shen, Yujiu Yang
- NeurIPS 2025 poster
- Readers: Everyone

View all 41 publications

Co-Authors

View all 149 co-authors