Dealing with partial labels by knowledge distillation

Guangtai Wang, Jintao Huang, Yiqiang Lai, Chi-Man Vong

Abstract: Highlights•Different samples have different possibilities to have candidate labels.•Knowledge distillation can utilize the clean samples in partial label learning.•Different labels have different potential to be a candidate label.•Knowledge distillation can effectively reduce the harm of noise in partial label learning.