Multi-level knowledge distillation via dynamic decision boundaries exploration and exploitation

Ze Tao, Haowei Li, Jian Zhang, Shichao Zhang

Abstract: Highlights•MLKD uses decision boundaries for multi-source feature fusion.•MLKD is employed to facilitate the student model’s self-reflective distillation.•MLKD achieves state-of-the-art results in five benchmark datasets.