AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving

Download PDF
Open Webpage

Zhuohan Li, Lianmin Zheng, Yinmin Zhong, Vincent Liu, Ying Sheng, Xin Jin, Yanping Huang, Zhifeng Chen, Hao Zhang, Joseph E. Gonzalez, Ion Stoica

Published: 01 Jan 2023, Last Modified: 13 Nov 2024OSDI 2023EveryoneRevisionsBibTeXCC BY-SA 4.0