Scaling Beyond the GPU Memory Limit for Large Mixture-of-Experts Model Training

Open Webpage

Yechan Kim, Hwijoon Lim, Dongsu Han

Published: 01 Jan 2024, Last Modified: 26 Jan 2025ICML 2024EveryoneRevisionsBibTeXCC BY-SA 4.0