Whale: Efficient Giant Model Training over Heterogeneous GPUs

Download PDF
Open Webpage

Xianyan Jia, Le Jiang, Ang Wang, Wencong Xiao, Ziji Shi, Jie Zhang, Xinyuan Li, Langshi Chen, Yong Li, Zhen Zheng, Xiaoyong Liu, Wei Lin

Published: 01 Jan 2022, Last Modified: 15 May 2025USENIX ATC 2022EveryoneRevisionsBibTeXCC BY-SA 4.0