FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models

Open Webpage

Xinglin Pan, Wenxiang Lin, Lin Zhang, Shaohuai Shi, Zhenheng Tang, Rui Wang, Bo Li, Xiaowen Chu

Published: 01 Jan 2025, Last Modified: 27 Apr 2025ASPLOS (1) 2025EveryoneRevisionsBibTeXCC BY-SA 4.0