VIDUR: A Large-Scale Simulation Framework for LLM Inference

Download PDF
Open Webpage

Amey Agrawal, Nitin Kedia, Jayashree Mohan, Ashish Panwar, Nipun Kwatra, Bhargav S. Gulavani, Ramachandran Ramjee, Alexey Tumanov

Published: 01 Jan 2024, Last Modified: 23 Mar 2025MLSys 2024EveryoneRevisionsBibTeXCC BY-SA 4.0