MuxServe: Flexible Spatial-Temporal Multiplexing for Multiple LLM Serving

Open Webpage

Jiangfei Duan, Runyu Lu, Haojie Duanmu, Xiuhong Li, Xingcheng Zhang, Dahua Lin, Ion Stoica, Hao Zhang

Published: 01 Jan 2024, Last Modified: 14 Nov 2024ICML 2024EveryoneRevisionsBibTeXCC BY-SA 4.0