Deferred Continuous Batching in Resource-Efficient Large Language Model Serving

Open Webpage

Yongjun He, Yao Lu, Gustavo Alonso

Published: 01 Jan 2024, Last Modified: 04 Aug 2025EuroMLSys@EuroSys 2024EveryoneRevisionsBibTeXCC BY-SA 4.0