Yutao Zeng

Researcher, ByteDance Inc.

Joined

February 2023

Names

Yutao Zeng (Preferred)

Emails

****@outlook.com (Confirmed)

****@bytedance.com (Confirmed)

Personal Links

Career & Education History

Researcher

ByteDance Inc. (bytedance.com)

2023 – Present

Researcher

Tencent Inc. (tencent.com)

2021 – 2023

Advisors, Relations & Conflicts

Coworker

Ya Wang

2023 – Present

Expertise

LLMs

Pre-training

Present

Knowledge Graph

Information Extraction

Present

Publications

Scale-Distribution Decoupling: Enabling Stable and Effective Training of Large Language Models
Ya Wang, Yutao Zeng, Zhijian Zhuo, Jian Yang, zhou Xun, Xiaoqing Li
- Submitted to ICLR 2026
- Readers: Everyone
Scaling Law for Quantization-Aware Training
Mengzhao Chen, Chaoyi Zhang, Jing Liu, Yutao Zeng, Zeyue Xue, Zhiheng Liu, Yunshui Li, Jin Ma, Jie Huang, zhou Xun, Ping Luo
- Submitted to ICLR 2026
- Readers: Everyone
GatePro: Parameter-Free Expert Selection Optimization for Mixture-of-Experts Models
Chen Zheng, Yuhang Cai, Deyi Liu, Jin Ma, Yiyuan Ma, Yuan Yang, Jing Liu, Yutao Zeng, Xun Zhou, Siyuan Qiao
- Submitted to ICLR 2026
- Readers: Everyone
HSA: Head-wise Sparse Attention for Efficient and Accurate Long-context Inference
Jing Liu, Jianqiao Lu, Yao Luo, Yuan Yang, Chen Zheng, Deyi Liu, Mengzhao Chen, Chaoyi Zhang, Yunshui Li, Jin Ma, Yutao Zeng, Ya Wang, Hongmin chen, Ziqiang Pei, Fan Xia, Tianqi Zhang, Xiaoying Jia, Yiyuan Ma, Siyuan Qiao
- ICLR 2026 Conference Withdrawn Submission
- Readers: Everyone
UltraMemV2: Memory Networks Scaling to 120B Parameters with Superior Long-Context Learning
Zihao Huang, Yu Bao, Qiyang Min, Siyan Chen, Ran Guo, Hongzhi Huang, Defa Zhu, Banggu Wu, Yutao Zeng, zhou Xun, Siyuan Qiao
- ICLR 2026 Poster
- Readers: Everyone
HybridNorm: Towards Stable and Efficient Transformer Training via Hybrid Normalization
Zhijian Zhuo, Yutao Zeng, Ya Wang, Sijun Zhang, Xiaoqing Li, Jian Yang, zhou Xun, Jinwen Ma
- NeurIPS 2025 poster
- Readers: Everyone
Stepsize anything: A unified learning rate schedule for budgeted-iteration training
Anda Tang, Yiming Dong, Yutao Zeng, zhou Xun, Zhouchen Lin
- NeurIPS 2025 poster
- Readers: Everyone
Over-Tokenized Transformer: Vocabulary is Generally Worth Scaling
Hongzhi Huang, Defa Zhu, Banggu Wu, Yutao Zeng, Ya Wang, Qiyang Min, zhou Xun
- ICML 2025 poster
- Readers: Everyone
Polynomial Composition Activations: Unleashing the Dynamics of Large Language Models
Zhijian Zhuo, Ya Wang, Yutao Zeng, Xiaoqing Li, Xun Zhou, Jinwen Ma
- ICLR 2025 Poster
- Readers: Everyone
Ultra-Sparse Memory Network
Zihao Huang, Qiyang Min, Hongzhi Huang, Yutao Zeng, Defa Zhu, Ran Guo, zhou Xun
- ICLR 2025 Poster
- Readers: Everyone

View all 18 publications

Co-Authors

View all 69 co-authors