Shaoduo Gan

Postdoc, Peking University

Joined

July 2019

Names

Shaoduo Gan

Emails

****@inf.ethz.ch (Confirmed)

****@gmail.com (Confirmed)

****@outlook.com (Confirmed)

****@pku.edu.cn (Confirmed)

Personal Links

Google Scholar

DBLP

Career & Education History

Postdoc

Peking University (pku.edu.cn)

2024 – 2026

PhD student

Swiss Federal Institute of Technology (ethz.ch)

2017 – 2023

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

SqueezeAttention: 2D Management of KV-Cache in LLM Inference via Layer-wise Optimal Budget
Zihao Wang, Bin CUI, Shaoduo Gan
- ICLR 2025 Poster
- Readers: Everyone
FRuDA: Framework for Distributed Adversarial Domain Adaptation
Shaoduo Gan, Akhil Mathur, Anton Isopoussu, Fahim Kawsar, Nadia Berthouze, Nicholas D. Lane
- 2022 (modified: 12 Nov 2022)
- IEEE Trans. Parallel Distributed Syst. 2022
- Readers: Everyone
Stochastic Gradient Descent without Full Data Shuffle
Lijie Xu, Shuang Qiu, Binhang Yuan, Jiawei Jiang, Cédric Renggli, Shaoduo Gan, Kaan Kara, Guoliang Li, Ji Liu, Wentao Wu, Jieping Ye, Ce Zhang
- 2022 (modified: 17 Jan 2023)
- CoRR 2022
- Readers: Everyone
In-Database Machine Learning with CorgiPile: Stochastic Gradient Descent without Full Data Shuffle
Lijie Xu, Shuang Qiu, Binhang Yuan, Jiawei Jiang, Cédric Renggli, Shaoduo Gan, Kaan Kara, Guoliang Li, Ji Liu, Wentao Wu, Jieping Ye, Ce Zhang
- 2022 (modified: 17 Jan 2023)
- SIGMOD Conference 2022
- Readers: Everyone
Few-shot Named Entity Recognition with Entity-level Prototypical Network Enhanced by Dispersedly Distributed Prototypes
Bin Ji, Shasha Li, Shaoduo Gan, Jie Yu, Jun Ma, Huijun Liu, Jing Yang
- Published: 01 Jan 2022, Last Modified: 26 Apr 2023
- COLING 2022
- Readers: Everyone
Few-shot Named Entity Recognition with Entity-level Prototypical Network Enhanced by Dispersedly Distributed Prototypes
Bin Ji, Shasha Li, Shaoduo Gan, Jie Yu, Jun Ma, Huijun Liu
- Published: 01 Jan 2022, Last Modified: 26 Apr 2023
- CoRR 2022
- Readers: Everyone
Ease.ML: A Lifecycle Management System for Machine Learning
Leonel Aguilar Melgar, David Dao, Shaoduo Gan, Nezihe Merve Gürel, Nora Hollenstein, Jiawei Jiang, Bojan Karlas, Thomas Lemmin, Tian Li, Yang Li, Xi Rao, Johannes Rausch, Cédric Renggli, Luka Rimanic, Maurice Weber, Shuai Zhang, Zhikuan Zhao, Kevin Schawinski, Wentao Wu, Ce Zhang
- 2021 (modified: 26 Apr 2023)
- CIDR 2021
- Readers: Everyone
BAGUA: Scaling up Distributed Learning with System Relaxations
Shaoduo Gan, Xiangru Lian, Rui Wang, Jianbin Chang, Chengjun Liu, Hongmei Shi, Shengzhuo Zhang, Xianghong Li, Tengxu Sun, Jiawei Jiang, Binhang Yuan, Sen Yang, Ji Liu, Ce Zhang
- 2021 (modified: 31 Mar 2022)
- CoRR 2021
- Readers: Everyone
1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed
Hanlin Tang, Shaoduo Gan, Ammar Ahmad Awan, Samyam Rajbhandari, Conglong Li, Xiangru Lian, Ji Liu, Ce Zhang, Yuxiong He
- 2021 (modified: 31 Mar 2022)
- ICML 2021
- Readers: Everyone
1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed
Hanlin Tang, Shaoduo Gan, Ammar Ahmad Awan, Samyam Rajbhandari, Conglong Li, Xiangru Lian, Ji Liu, Ce Zhang, Yuxiong He
- 2021 (modified: 31 Mar 2022)
- CoRR 2021
- Readers: Everyone

View all 22 publications

Co-Authors

View all 66 co-authors