Not All Layers Are Equal: A Layer-Wise Adaptive Approach Toward Large-Scale DNN Training

Yun-Yong Ko, Dongwon Lee, Sang-Wook Kim