Feature-map-level Online Adversarial Knowledge Distillation

Inseop Chung, Seonguk Park, Jangho Kim, Nojun Kwak

Abstract: Feature maps contain rich information about image intensity and spatial correlation. However, previous online knowledge distillation methods only utilize the class probabilities. Thus in this paper...