AdaDS: Adaptive data selection for accelerating pre-trained language model knowledge distillation

Qinhong Zhou, Peng Li, Yang Liu, Yuyang Guan, Qizhou Xing, Ming Chen, Maosong Sun