Galvatron: An Automatic Distributed System for Efficient Foundation Model Training.

Xinyi Liu, Yujie Wang, Shenhan Zhu, Fangcheng Fu, Qingshuo Liu, Guangming Lin, Bin Cui 0001