Saurabh Agarwal

Postdoc, Computer Sciences, University of Texas at Austin

Joined

September 2020

Names

Saurabh Agarwal (Preferred)

Emails

****@cs.wisc.edu (Confirmed)

****@cs.utexas.edu (Confirmed)

****@utexas.edu (Confirmed)

Personal Links

Homepage

Career & Education History

Postdoc

Computer Sciences, University of Texas at Austin (utexas.edu)

2025 – Present

Student

Computer Sciences, University of Wisconsin, Madison (wisc.edu)

2018 – 2025

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

UNUM: A New Framework for Network Control
Jiayi Chen, Nihal Sharma, Debajit Chakraborty, Saurabh Agarwal, Jeffrey Zhou, Aditya Akella, Sanjay Shakkottai
- 23rd USENIX Symposium on Networked Systems Design and Implementation
- Readers: Everyone
Everything Everywhere All at Once: LLMs can In-Context Learn Multiple Tasks in Superposition
Zheyang Xiong, Ziyang Cai, John Cooper, Albert Ge, Vasilis Papageorgiou, Zack Sifakis, Angeliki Giannou, Ziqian Lin, Liu Yang, Saurabh Agarwal, Grigorios Chrysos, Samet Oymak, Kangwook Lee, Dimitris Papailiopoulos
- ICML 2025 spotlightposter
- Readers: Everyone
Everything Everywhere All at Once: LLMs can In-Context Learn Multiple Tasks in Superposition
Zheyang Xiong, Ziyang Cai, John Cooper, Albert Ge, Vasilis Papageorgiou, Zack Sifakis, Angeliki Giannou, Ziqian Lin, Liu Yang, Saurabh Agarwal, Grigorios Chrysos, Samet Oymak, Kangwook Lee, Dimitris Papailiopoulos
- Submitted to ICLR 2025
- Readers: Everyone
CHAI: Clustered Head Attention for Efficient LLM Inference
Saurabh Agarwal, Bilge Acun, Basil Hosmer, Mostafa Elhoushi, Yejin Lee, Shivaram Venkataraman, Dimitris Papailiopoulos, Carole-Jean Wu
- ICML 2024 Poster
- Readers: Everyone
BagPipe: Accelerating Deep Recommendation Model Training
Saurabh Agarwal, Ziyi Zhang, Shivaram Venkataraman
- Published: 01 Jan 2022, Last Modified: 27 Apr 2023
- CoRR 2022
- Readers: Everyone
On the Utility of Gradient Compression in Distributed Training Systems
Saurabh Agarwal, Hongyi Wang, Shivaram Venkataraman, Dimitris S. Papailiopoulos
- Published: 01 Jan 2022, Last Modified: 27 Apr 2023
- MLSys 2022
- Readers: Everyone
Adaptive Gradient Communication via Critical Learning Regime Identification
Saurabh Agarwal, Hongyi Wang, Kangwook Lee, Shivaram Venkataraman, Dimitris S. Papailiopoulos
- 2021 (modified: 16 Apr 2023)
- MLSys 2021
- Readers: Everyone
Pufferfish: Communication-efficient Models At No Extra Cost
Hongyi Wang, Saurabh Agarwal, Dimitris S. Papailiopoulos
- Published: 01 Jan 2021, Last Modified: 27 Apr 2023
- MLSys 2021
- Readers: Everyone
AutoFreeze: Automatically Freezing Model Blocks to Accelerate Fine-tuning
Yuhan Liu, Saurabh Agarwal, Shivaram Venkataraman
- Published: 01 Jan 2021, Last Modified: 27 Apr 2023
- CoRR 2021
- Readers: Everyone
Pufferfish: Communication-efficient Models At No Extra Cost
Hongyi Wang, Saurabh Agarwal, Dimitris S. Papailiopoulos
- Published: 01 Jan 2021, Last Modified: 27 Apr 2023
- CoRR 2021
- Readers: Everyone

View all 15 publications

Co-Authors

View all 36 co-authors