Amey Agrawal

PhD student, Compute Science, Georgia Institute of Technology

Joined

June 2021

Names

Amey Agrawal (Preferred)

Emails

****@gmail.com (Confirmed)

Personal Links

Homepage

Google Scholar

DBLP

Career & Education History

PhD student

Compute Science, Georgia Institute of Technology (gatech.edu)

2022 – Present

Software Engineer

Microsoft Research, India (microsoft.com)

2021 – 2022

Member of Technical Staff

Qubole Inc. (qubole.com)

2018 – 2020

Undergrad student

BITS Pilani (bits-pilani.ac.in)

2014 – 2018

Advisors, Relations & Conflicts

PhD Advisor

Alexey Tumanov

2022 – Present

Expertise

No areas of expertise listed

Publications

Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve
Amey Agrawal, Nitin Kedia, Ashish Panwar, Jayashree Mohan, Nipun Kwatra, Bhargav S. Gulavani, Alexey Tumanov, Ramachandran Ramjee
- CoRR 2024
- Readers: Everyone
VIDUR: A Large-Scale Simulation Framework for LLM Inference
Amey Agrawal, Nitin Kedia, Jayashree Mohan, Ashish Panwar, Nipun Kwatra, Bhargav S. Gulavani, Ramachandran Ramjee, Alexey Tumanov
- MLSys 2024
- Readers: Everyone
Vidur: A Large-Scale Simulation Framework For LLM Inference
Amey Agrawal, Nitin Kedia, Jayashree Mohan, Ashish Panwar, Nipun Kwatra, Bhargav S. Gulavani, Ramachandran Ramjee, Alexey Tumanov
- CoRR 2024
- Readers: Everyone
Metron: Holistic Performance Evaluation Framework for LLM Inference Systems
Amey Agrawal, Anmol Agarwal, Nitin Kedia, Jayashree Mohan, Souvik Kundu, Nipun Kwatra, Ramachandran Ramjee, Alexey Tumanov
- CoRR 2024
- Readers: Everyone
Mnemosyne: Parallelization Strategies for Efficiently Serving Multi-Million Context Length LLM Inference Requests Without Approximations
Amey Agrawal, Junda Chen, Íñigo Goiri, Ramachandran Ramjee, Chaojie Zhang, Alexey Tumanov, Esha Choukse
- CoRR 2024
- Readers: Everyone
Inshrinkerator: Compressing Deep Learning Training Checkpoints via Dynamic Quantization
Amey Agrawal, Sameer Reddy, Satwik Bhattamishra, Venkata Prabhakara Sarath Nookala, Vidushi Vashishth, Kexin Rong, Alexey Tumanov
- SoCC 2024
- Readers: Everyone
SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefills
Amey Agrawal, Ashish Panwar, Jayashree Mohan, Nipun Kwatra, Bhargav S. Gulavani, Ramachandran Ramjee
- CoRR 2023
- Readers: Everyone
DynaQuant: Compressing Deep Learning Training Checkpoints via Dynamic Quantization
Amey Agrawal, Sameer Reddy, Satwik Bhattamishra, Venkata Prabhakara Sarath Nookala, Vidushi Vashishth, Kexin Rong, Alexey Tumanov
- CoRR 2023
- Readers: Everyone
Singularity: Planet-Scale, Preemptive and Elastic Scheduling of AI Workloads
Dharma Shukla, Muthian Sivathanu, Srinidhi Viswanatha, Bhargav S. Gulavani, Rimma Nehme, Amey Agrawal, Chen Chen, Nipun Kwatra, Ramachandran Ramjee, Pankaj Sharma, Atul Katiyar, Vipul Modi, Vaibhav Sharma, Abhishek Singh, Shreshth Singhal, Kaustubh Welankar, Lu Xun, Ravi Anupindi, Karthik Elangovan, Hasibur Rahman et al. (6 additional authors not shown)
- CoRR 2022
- Readers: Everyone

View all 14 publications

Co-Authors

View all 46 co-authors