One Teacher is Enough? Pre-trained Language Model Distillation from Multiple Teachers

Chuhan Wu, Fangzhao Wu, Yongfeng Huang