Xunhao Lai

MS student, Peking University

Joined

September 2024

Names

Xunhao Lai (Preferred)

Emails

****@pku.edu.cn (Confirmed)

Personal Links

Career & Education History

MS student

Peking University (pku.edu.cn)

2023 – 2026

Undergrad student

Peking University (pku.edu.cn)

2019 – 2023

Advisors, Relations & Conflicts

Coauthor

Present

Expertise

No areas of expertise listed

Publications

Enhancing linear attention with residual learning
Xunhao Lai, Jialiang Kang, Jianqiao Lu, Tong Lin, Pengyu Zhao
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
Model Merging in Pre-training of Large Language Models
Yunshui Li, Yiyuan Ma, Shen Yan, Chaoyi Zhang, Jing Liu, Jianqiao Lu, Ziwen Xu, Mengzhao Chen, Minrui Wang, Shiyi Zhan, Jin Ma, Xunhao Lai, Yao Luo, Xingyan Bin, Hongbin Ren, Mingji Han, Wenhao Hao, Bairen Yi, LingJun Liu, Bole Ma et al. (4 additional authors not shown)
- NeurIPS 2025 poster
- Readers: Everyone
Fira: Can We Achieve Full-rank Training of LLMs Under Low-rank Constraint?
Xi Chen, Kaituo Feng, Changsheng Li, Xunhao Lai, Xiangyu Yue, Ye Yuan, Guoren Wang
- NeurIPS 2025 poster
- Readers: Everyone
Fira: Can We Achieve Full-rank Training of LLMs Under Low-rank Constraint?
Xi Chen, Kaituo Feng, Changsheng Li, Xunhao Lai, Xiangyu Yue, Ye Yuan, Guoren Wang
- Submitted to ICLR 2025
- Readers: Everyone
FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
Xunhao Lai, Jianqiao Lu, Yao Luo, Yiyuan Ma, Xun Zhou
- ICLR 2025 Oral
- Readers: Everyone

Co-Authors

View all 33 co-authors