AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving

Download PDF
Open Webpage

Zhuohan Li, Lianmin Zheng, Yinmin Zhong, Vincent Liu, Ying Sheng, Xin Jin, Yanping Huang, Zhifeng Chen, Hao Zhang, Joseph E. Gonzalez, Ion Stoica

Published: 2023, Last Modified: 27 Jan 2026OSDI 2023EveryoneRevisionsBibTeXCC BY-SA 4.0