Zihan Qiu

Researcher, Qwen Team, Alibaba Group

Joined

May 2022

Names

Zihan Qiu (Preferred)

Emails

****@gmail.com (Confirmed)

****@mails.tsinghua.edu.cn (Confirmed)

****@alibaba-inc.com (Confirmed)

Personal Links

Google Scholar

DBLP

ACL Anthology

Career & Education History

Researcher

Qwen Team, Alibaba Group (alibaba-inc.com)

2024 – Present

Undergrad student

IIIS, Tsinghua University, Tsinghua University (tsinghua.edu.cn)

2020 – 2024

Advisors, Relations & Conflicts

No relations added

Expertise

Natural Language Processing

2023 – Present

Modular Networks

2022 – Present

Mixture of Experts

2022 – Present

Publications

Blending Supervised and Reinforcement Fine-Tuning with Prefix Sampling
Zeyu Huang, Tianhao Cheng, Zihan Qiu, Zili Wang, Xu Yinghui, Edoardo Ponti, Ivan Titov
- Submitted to ICLR 2026
- Readers: Everyone
A Controllable Examination for Long-Context Language Models
Yijun Yang, Zeyu Huang, Wenhao Zhu, Zihan Qiu, Fei Yuan, Jeff Z. Pan, Ivan Titov
- NeurIPS 2025 Datasets and Benchmarks Track spotlight
- Readers: Everyone
Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
Zihan Qiu, Zekun Wang, Bo Zheng, Zeyu Huang, Kaiyue Wen, Songlin Yang, Rui Men, Le Yu, Fei Huang, Suozhi Huang, Dayiheng Liu, Jingren Zhou, Junyang Lin
- NeurIPS 2025 oral
- Readers: Everyone
Post-hoc Reward Calibration: A Case Study on Length Bias
Zeyu Huang, Zihan Qiu, Zili Wang, Edoardo M. Ponti, Ivan Titov
- ICLR 2025
- Readers: Everyone
Layerwise Recurrent Router for Mixture-of-Experts
Zihan Qiu, Zeyu Huang, Shuang Cheng, Yizhi Zhou, Zili Wang, Ivan Titov, Jie Fu
- ICLR 2025
- Readers: Everyone
Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models
Zihan Qiu, Zeyu Huang, Bo Zheng, Kaiyue Wen, Zekun Wang, Rui Men, Ivan Titov, Dayiheng Liu, Jingren Zhou, Junyang Lin
- CoRR 2025
- Readers: Everyone
Post-hoc Reward Calibration: A Case Study on Length Bias
Zeyu Huang, Zihan Qiu, Zili Wang, Edoardo Ponti, Ivan Titov
- ICLR 2025 Poster
- Readers: Everyone
Layerwise Recurrent Router for Mixture-of-Experts
Zihan Qiu, Zeyu Huang, Shuang Cheng, Yizhi Zhou, Zili Wang, Ivan Titov, Jie Fu
- ICLR 2025 Poster
- Readers: Everyone
Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training
Wenyu Du, Tongxu Luo, Zihan Qiu, Zeyu Huang, Yikang Shen, Reynold Cheng, Yike Guo, Jie Fu
- NeurIPS 2024 spotlight
- Readers: Everyone
GW-MoE: Resolving Uncertainty in MoE Router with Global Workspace Theory
Haoze Wu, Zihan Qiu, Zili Wang, Hang Zhao, Jie Fu
- CoRR 2024
- Readers: Everyone

View all 31 publications

Co-Authors

View all 89 co-authors