Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow

Open Webpage

Yixuan Mei, Yonghao Zhuang, Xupeng Miao, Juncheng Yang, Zhihao Jia, Rashmi Vinayak

Published: 01 Jan 2025, Last Modified: 15 May 2025ASPLOS (1) 2025EveryoneRevisionsBibTeXCC BY-SA 4.0