Yao Luo

Joined

September 2024

Names

Yao Luo (Preferred)

Emails

****@bytedance.com (Confirmed)

Personal Links

Career & Education History

Researcher

ByteDance Inc. (bytedance.com)

2022 – 2024

MS student

School of Computing, National University of Singapore (nus.edu)

2020 – 2021

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

HSA: Head-wise Sparse Attention for Efficient and Accurate Long-context Inference
Jing Liu, Jianqiao Lu, Yao Luo, Yuan Yang, Chen Zheng, Deyi Liu, Mengzhao Chen, Chaoyi Zhang, Yunshui Li, Jin Ma, Yutao Zeng, Ya Wang, Hongmin chen, Ziqiang Pei, Fan Xia, Tianqi Zhang, Xiaoying Jia, Yiyuan Ma, Siyuan Qiao
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
Model Merging in Pre-training of Large Language Models
Yunshui Li, Yiyuan Ma, Shen Yan, Chaoyi Zhang, Jing Liu, Jianqiao Lu, Ziwen Xu, Mengzhao Chen, Minrui Wang, Shiyi Zhan, Jin Ma, Xunhao Lai, Yao Luo, Xingyan Bin, Hongbin Ren, Mingji Han, Wenhao Hao, Bairen Yi, LingJun Liu, Bole Ma et al. (4 additional authors not shown)
- NeurIPS 2025 poster
- Readers: Everyone
Why Does the Effective Context Length of LLMs Fall Short?
Chenxin An, Jun Zhang, Ming Zhong, Lei Li, Shansan Gong, Yao Luo, Jingjing Xu, Lingpeng Kong
- ICLR 2025 Poster
- Readers: Everyone
FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
Xunhao Lai, Jianqiao Lu, Yao Luo, Yiyuan Ma, Xun Zhou
- ICLR 2025 Oral
- Readers: Everyone

Co-Authors

View all 41 co-authors