ZeRO-Offload: Democratizing Billion-Scale Model Training

Download PDF
Open Webpage

Jie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi, Olatunji Ruwase, Shuangyan Yang, Minjia Zhang, Dong Li, Yuxiong He

Published: 2021, Last Modified: 07 Jan 2026USENIX ATC 2021EveryoneRevisionsBibTeXCC BY-SA 4.0