Zhenghao Lin

Researcher, Microsoft

Joined

January 2023

Names

Zhenghao Lin (Preferred)

Emails

****@stu.xmu.edu.cn (Confirmed)

****@qq.com (Confirmed)

****@gmail.com (Confirmed)

****@microsoft.com (Confirmed)

Personal Links

Google Scholar

DBLP

ORCID

Career & Education History

Researcher

Microsoft (microsoft.com)

2025 – Present

Intern

Microsoft (microsoft.com)

2023 – 2025

MS student

Xiamen University (xmu.edu.cn)

2022 – 2025

Undergrad student

Xiamen University (xmu.edu.cn)

2018 – 2022

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

Beyond Length: Quantifying Long-Range Information for Long-Context LLM Pretraining Data
Haoran Deng, Yingyu Lin, Zhenghao Lin, Xiao Liu, Yizhou Sun, Yian Ma, Yeyun Gong
- ICLR 2026 Poster
- Readers: Everyone
Behind RoPE: How Does Causal Mask Encode Positional Information?
Junu Kim, Xiao Liu, Zhenghao Lin, Lei Ji, Yeyun Gong, Edward Choi
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
Learning from the Best, Differently: A Diversity-Driven Rethinking on Data Selection
Hongyi He, Xiao Liu, Zhenghao Lin, Mingni Tang, Yi Cheng, Jintao Wang, Wenjie Li, Yeyun Gong, Peng CHENG
- Submitted to ICLR 2026
- Readers: Everyone
Sigma: Differential Rescaling of Query, Key and Value for Efficient Language Models
Zhenghao Lin, Zihao Tang, Xiao Liu, Yeyun Gong, Yi Cheng, Qi Chen, Hang Li, Ying Xin, Ziyue Yang, Kailai Yang, Yu Yan, Xiao Liang, Shuai Lu, Yiming Huang, Zheheng Luo, Lei Qu, Xuan Feng, Yaoxiang Wang, Yuqing Xia, Feiyang Chen et al. (14 additional authors not shown)
- CoRR 2025
- Readers: Everyone
Not All Tokens Are What You Need for Pretraining
Zhenghao Lin, Zhibin Gou, Yeyun Gong, Xiao Liu, yelong shen, Ruochen Xu, Chen Lin, Yujiu Yang, Jian Jiao, Nan Duan, Weizhu Chen
- NeurIPS 2024 oral
- Readers: Everyone
AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotators
Xingwei He, Zhenghao Lin, Yeyun Gong, A-Long Jin, Hang Zhang, Chen Lin, Jian Jiao, Siu Ming Yiu, Nan Duan, Weizhu Chen
- NAACL (Industry Track) 2024
- Readers: Everyone
Not All Tokens Are What You Need for Pretraining
Zhenghao Lin, Zhibin Gou, Yeyun Gong, Xiao Liu, Yelong Shen, Ruochen Xu, Chen Lin, Yujiu Yang, Jian Jiao, Nan Duan, Weizhu Chen
- NeurIPS 2024
- Readers: Everyone
Rho-1: Not All Tokens Are What You Need
Zhenghao Lin, Zhibin Gou, Yeyun Gong, Xiao Liu, Yelong Shen, Ruochen Xu, Chen Lin, Yujiu Yang, Jian Jiao, Nan Duan, Weizhu Chen
- CoRR 2024
- Readers: Everyone
Revolutionizing Database Q&A with Large Language Models: Comprehensive Benchmark and Evaluation
Yihang Zheng, Bo Li, Zhenghao Lin, Yi Luo, Xuanhe Zhou, Chen Lin, Jinsong Su, Guoliang Li, Shifu Li
- CoRR 2024
- Readers: Everyone
Competition-Level Problems are Effective LLM Evaluators
Yiming Huang, Zhenghao Lin, Xiao Liu, Yeyun Gong, Shuai Lu, Fangyu Lei, Yaobo Liang, Yelong Shen, Chen Lin, Nan Duan, Weizhu Chen
- ACL (Findings) 2024
- Readers: Everyone

View all 15 publications

Co-Authors

View all 76 co-authors