Consistency knowledge distillation based on similarity attribute graph guidance

Open Webpage

Jiaqi Ma, Jinfu Yang, Fuji Fu, Jiahui Zhang

Published: 2025, Last Modified: 29 Oct 2025Expert Syst. Appl. 2025EveryoneRevisionsBibTeXCC BY-SA 4.0
Abstract: Highlights•Propose a Consistency Knowledge Distillation method via similarity attribute graphs.•Design a SimAGB module to characterize the distribution of sample embeddings.•Design a ConKD module to reach knowledge transfer and optimize feature distribution.