Cong Xie

PhD student, University of Illinois, Urbana Champaign

Joined

March 2017

Names

Cong Xie

Emails

****@illinois.edu (Confirmed)

****@bytedance.com (Confirmed)

****@gmail.com (Confirmed)

Personal Links

Homepage

Google Scholar

Career & Education History

PhD student

University of Illinois, Urbana Champaign (illinois.edu)

2016 – Present

MS student

Shanghai Jiao Tong University (sjtu.edu.cn)

2013 – 2016

Undergrad student

Shanghai Jiao Tong University (sjtu.edu.cn)

2009 – 2013

Advisors, Relations & Conflicts

PhD Advisor

Indranil Gupta

2016 – 2021

PhD Advisor

Oluwasanmi Koyejo

2016 – 2021

Expertise

distributed machine learning

Present

distributed graph computing

Present

Publications

Cautious Weight Decay
Lizhang Chen, Jonathan Li, Kaizhao Liang, Baiyu Su, Cong Xie, Chen Liang, Ni Lao, qiang liu
- ICLR 2026 Poster
- Readers: Everyone
PrunedLoRA: Robust Gradient-Based Structured Pruning for Low-rank Adaptation in Fine-tuning
Xin Yu, Cong Xie, Ziyu Zhao, Tiantian Fan, Lingzhou Xue, Zhi Zhang
- Submitted to ICLR 2026
- Readers: Everyone
Truncated Proximal Policy Optimization
Tiantian Fan, LingJun Liu, Yue Yu, Jiaze Chen, Chengyi Wang, Qiying Yu, Chi Zhang, Zhiqi Lin, Ruofei Zhu, Yufeng Yuan, Xiaochen Zuo, Bole Ma, Mofan Zhang, Gaohong Liu, Ru Zhang, Haotian Zhou, Cong Xie, Ruidong Zhu, Lin Yan, Mingxuan Wang et al. (3 additional authors not shown)
- Submitted to ICLR 2026
- Readers: Everyone
DUO: No Compromise to Accuracy Degradation
Jinda Jia, Cong Xie, Hanlin Lu, Fanjiang Ye, Hao Feng, Daoce Wang, Haibin Lin, Zhi Zhang, Xin Liu
- NeurIPS 2025 poster
- Readers: Everyone
MoE-Pruner: Pruning Mixture-of-Experts Large Language Model using the Hints from Its Router
Yanyue Xie, Zhi Zhang, Ding Zhou, Cong Xie, Ziang Song, Xin Liu, Yanzhi Wang, Xue Lin, An Xu
- ICLR 2025 Conference Withdrawn Submission
- Readers: Everyone
SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training
Jinda Jia, Cong Xie, Hanlin Lu, Daoce Wang, Hao Feng, Chengming Zhang, Baixi Sun, Haibin Lin, Zhi Zhang, Xin Liu, Dingwen Tao
- NeurIPS 2024 poster
- Readers: Everyone
LEMON: Lossless model expansion
Yite Wang, Jiahao Su, Hanlin Lu, Cong Xie, Tianyi Liu, Jianbo Yuan, Haibin Lin, Ruoyu Sun, Hongxia Yang
- ICLR 2024 poster
- Readers: Everyone
SAPipe: Staleness-Aware Pipeline for Data Parallel DNN Training
Yangrui Chen, Cong Xie, Meng Ma, Juncheng Gu, Yanghua Peng, Haibin Lin, Chuan Wu, Yibo Zhu
- Published: 31 Oct 2022, Last Modified: 25 Oct 2022
- NeurIPS 2022 Accept
- Readers: Everyone
Zeno: Distributed Stochastic Gradient Descent with Suspicion-based Fault-tolerance
Cong Xie, Sanmi Koyejo, Indranil Gupta
- 2019 (modified: 11 Nov 2022)
- ICML 2019
- Readers: Everyone
Wishart Mechanism for Differentially Private Principal Components Analysis
Wuxuan Jiang, Cong Xie, Zhihua Zhang
- 2016 (modified: 16 Jul 2019)
- AAAI 2016
- Readers: Everyone

View all 12 publications

Co-Authors

View all 66 co-authors