Beidi Chen

Assistant Professor, CMU, Carnegie Mellon University

Researcher, Facebook

Joined

November 2017

Names

Beidi Chen

Emails

****@rice.edu (Confirmed)

****@stanford.edu (Confirmed)

****@cs.stanford.edu (Confirmed)

****@andrew.cmu.edu (Confirmed)

Personal Links

Homepage

DBLP

Career & Education History

Assistant Professor

CMU, Carnegie Mellon University (andrew.cmu.edu)

2023 – Present

Researcher

Facebook (fb.com)

2022 – Present

Postdoc

Stanford University (stanford.edu)

2020 – 2022

PhD student

Rice University (rice.edu)

2015 – 2020

Undergrad student

University of California Berkeley (berkeley.edu)

2011 – 2015

Advisors, Relations & Conflicts

Postdoc Advisor

Christopher Re

2020 – Present

PhD Advisor

Anshumali Shrivastava

2015 – 2020

Expertise

Machine Learning Systems

2017 – Present

Large-scale Machine Learning

2015 – Present

Publications

Climbing the WOL: Training for Cheaper Inference
Zichang Liu, Zhaozhuo Xu, Alan B Ji, Jonathan Lingjie Li, Beidi Chen, Anshumali Shrivastava
- 06 Oct 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
HALOS: Hashing Large Output Space for Cheap Inference
Zichang Liu, Zhaozhuo Xu, Alan B Ji, Junyan Zhang, Jonathan Lingjie Li, Beidi Chen, Anshumali Shrivastava
- 06 Oct 2023 (modified: 06 Oct 2023)
- OpenReview Archive Direct Upload
- Readers: Everyone
High-throughput Generative Inference of Large Language Models with a Single GPU
Ying Sheng, Lianmin Zheng, Binhang Yuan, Zhuohan Li, Max Ryabinin, Beidi Chen, Percy Liang, Christopher Re, Ion Stoica, Ce Zhang
- 19 Apr 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
High-throughput Generative Inference of Large Language Models with a Single GPU
Ying Sheng, Lianmin Zheng, Binhang Yuan, Zhuohan Li, Max Ryabinin, Daniel Y. Fu, Zhiqiang Xie, Beidi Chen, Clark W. Barrett, Joseph E. Gonzalez, Percy Liang, Christopher Ré, Ion Stoica, Ce Zhang
- 2023 (modified: 14 Apr 2023)
- CoRR 2023
- Readers: Everyone
Modeling Scattering Coefficients using Self-Attentive Complex Polynomials with Image-based Representation
Andrew Cohen, Weiping Dou, Jiang Zhu, Slawomir Koziel, Peter Renner, Jan-Ove Mattsson, Xiaomeng Yang, Beidi Chen, Kevin Stone, Yuandong Tian
- 2023 (modified: 14 Apr 2023)
- CoRR 2023
- Readers: Everyone
Decentralized Training of Foundation Models in Heterogeneous Environments
Binhang Yuan, Yongjun He, Jared Quincy Davis, Tianyi Zhang, Tri Dao, Beidi Chen, Percy Liang, Christopher Re, Ce Zhang
- Published: 31 Oct 2022, Last Modified: 08 Feb 2026
- NeurIPS 2022 Accept
- Readers: Everyone
Fine-tuning Language Models over Slow Networks using Activation Quantization with Guarantees
Jue WANG, Binhang Yuan, Luka Rimanic, Yongjun He, Tri Dao, Beidi Chen, Christopher Re, Ce Zhang
- Published: 31 Oct 2022, Last Modified: 08 Feb 2026
- NeurIPS 2022 Accept
- Readers: Everyone
Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models
Beidi Chen, Tri Dao, Kaizhao Liang, Jiaming Yang, Zhao Song, Atri Rudra, Christopher Ré
- 2022 (modified: 14 Nov 2022)
- ICLR 2022
- Readers: Everyone
Decentralized Training of Foundation Models in Heterogeneous Environments
Binhang Yuan, Yongjun He, Jared Quincy Davis, Tianyi Zhang, Tri Dao, Beidi Chen, Percy Liang, Christopher Ré, Ce Zhang
- 2022 (modified: 16 Apr 2023)
- CoRR 2022
- Readers: Everyone
Fine-tuning Language Models over Slow Networks using Activation Compression with Guarantees
Jue Wang, Binhang Yuan, Luka Rimanic, Yongjun He, Tri Dao, Beidi Chen, Christopher Ré, Ce Zhang
- 2022 (modified: 16 Apr 2023)
- CoRR 2022
- Readers: Everyone

View all 43 publications

Co-Authors

View all 73 co-authors