Towards High-Goodput LLM Serving with Prefill-decode Multiplexing

Open Webpage

Yukang Chen, Weihao Cui, Han Zhao, Ziyi Xu, Xiaoze Fan, Xusheng Chen, Yangjie Zhou, Shixuan Sun, Bingsheng He, Quan Chen

Published: 22 Mar 2026, Last Modified: 11 Mar 2026CrossrefEveryoneRevisionsCC BY-SA 4.0