Xiaonan Nie

Researcher, Seed, ByteDance Inc.

Joined

May 2021

Names

Xiaonan Nie (Preferred)

Emails

****@pku.edu.cn (Confirmed)

****@bytedance.com (Confirmed)

Personal Links

Homepage

Google Scholar

DBLP

Career & Education History

Researcher

Seed, ByteDance Inc. (bytedance.com)

2024 – 2028

PhD student

Computer School, Peking University (pku.edu.cn)

2019 – 2024

Advisors, Relations & Conflicts

PhD Advisor

Bin Cui

2019 – 2024

Expertise

Large Language Model

2021 – 2024

Deep Learning System

2019 – 2024

Heterogeneous Computing

2019 – 2024

Publications

NetMoE: Accelerating MoE Training through Dynamic Sample Placement
Xinyi Liu, Yujie Wang, Fangcheng Fu, Xupeng Miao, Shenhan Zhu, Xiaonan Nie, Bin CUI
- ICLR 2025 Spotlight
- Readers: Everyone
LSH-MoE: Communication-efficient MoE Training via Locality-Sensitive Hashing
Xiaonan Nie, Qibin Liu, Fangcheng Fu, Shenhan Zhu, Xupeng Miao, Xiaoyang Li, Yang Zhang, Shouda Liu, Bin CUI
- NeurIPS 2024 poster
- Readers: Everyone
Hetu: a highly efficient automatic parallel distributed deep learning system
Xupeng Miao, Xiaonan Nie, Hailin Zhang, Tong Zhao, Bin Cui
- Published: 01 Jan 2023, Last Modified: 13 May 2023
- Sci. China Inf. Sci. 2023
- Readers: Everyone
FlexMoE: Scaling Large-scale Sparse Pre-trained Model Training via Dynamic Device Placement
Xiaonan Nie, Xupeng Miao, Zilong Wang, Zichao Yang, Jilong Xue, Lingxiao Ma, Gang Cao, Bin Cui
- Published: 01 Jan 2023, Last Modified: 22 Jan 2024
- Proc. ACM Manag. Data 2023
- Readers: Everyone
Angel-PTM: A Scalable and Economical Large-scale Pre-training System in Tencent
Xiaonan Nie, Yi Liu, Fangcheng Fu, Jinbao Xue, Dian Jiao, Xupeng Miao, Yangyu Tao, Bin Cui
- Published: 01 Jan 2023, Last Modified: 22 Jan 2024
- Proc. VLDB Endow. 2023
- Readers: Everyone
OSDP: Optimal Sharded Data Parallel for Distributed Deep Learning
Youhe Jiang, Fangcheng Fu, Xupeng Miao, Xiaonan Nie, Bin Cui
- Published: 01 Jan 2023, Last Modified: 22 Jan 2024
- IJCAI 2023
- Readers: Everyone
HET-GMP: A Graph-based System Approach to Scaling Large Embedding Model Training
Xupeng Miao, Yining Shi, Hailin Zhang, Xin Zhang, Xiaonan Nie, Zhi Yang, Bin Cui
- 2022 (modified: 16 Nov 2022)
- SIGMOD Conference 2022
- Readers: Everyone
TSPLIT: Fine-grained GPU Memory Management for Efficient DNN Training via Tensor Splitting
Xiaonan Nie, Xupeng Miao, Zhi Yang, Bin Cui
- 2022 (modified: 16 Nov 2022)
- ICDE 2022
- Readers: Everyone
Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism
Xupeng Miao, Yujie Wang, Youhe Jiang, Chunan Shi, Xiaonan Nie, Hailin Zhang, Bin Cui
- Published: 01 Jan 2022, Last Modified: 13 May 2023
- Proc. VLDB Endow. 2022
- Readers: Everyone
Dense-to-Sparse Gate for Mixture-of-Experts
Xiaonan Nie, Shijie Cao, Xupeng Miao, Lingxiao Ma, Jilong Xue, Youshan Miao, Zichao Yang, Zhi Yang, Bin CUI
- Published: 28 Jan 2022, Last Modified: 12 Oct 2025
- ICLR 2022 Submitted
- Readers: Everyone

View all 12 publications

Co-Authors

View all 31 co-authors