PipePar: Enabling fast DNN pipeline parallel training in heterogeneous GPU clusters

Jinghui Zhang, Geng Niu, Qiangsheng Dai, Haorui Li, Zhihua Wu, Fang Dong, Zhiang Wu