Revisiting Label Smoothing and Knowledge Distillation Compatibility: What was Missing?Download PDFOpen Website

Keshigeyan Chandrasegaran, Ngoc-Trung Tran, Yunqing Zhao, Ngai-Man Cheung

2022 (modified: 10 Nov 2022)ICML 2022Readers: Everyone
Abstract: This work investigates the compatibility between label smoothing (LS) and knowledge distillation (KD). Contemporary findings addressing this thesis statement take dichotomous standpoints: Muller et...
0 Replies