Relay knowledge distillation for efficiently boosting the performance of shallow networks

Shipeng Fu, Zhibing Lai, Yulun Zhang, Yiguang Liu, Xiaomin Yang