Regularizing Brain Age Prediction via Gated Knowledge Distillation

Yanwu Yang, Guo Xutao, Chenfei Ye, Yang Xiang, Ting Ma

Keywords: Knowledge distillation, Brain age estimation, Regularization

TL;DR: Brain age prediction with a novel Gated Knowledge Distillation regularization method.

Abstract: The brain age has been proven a phenotype with relevance to cognitive performance and brain disease. With the development of deep learning, brain age estimation accuracy has been greatly improved. However, such methods may incur over-fitting and suffer from poor generalizations, especially for insufficient brain imaging data. This paper presents a novel regularization method that penalizes the predictive distribution using knowledge distillation and introduces additional knowledge to reinforce the learning process. During knowledge distillation, we propose a gated distillation mechanism to enable the student model to attentively learn key knowledge from the teacher model, given the assumption that the teacher may not always be correct. Moreover, to enhance the capability of knowledge transfer, the hint representation similarity is also adopted to regularize the model training. We evaluate the model by a cohort of 3655 subjects from 4 public datasets, demonstrating that the proposed method improves the prediction performance over several well-established models, where the mean absolute error of the estimated ages is 2.129 years.

Registration: I acknowledge that publication of this at MIDL and in the proceedings requires at least one of the authors to register and present the work during the conference.

Authorship: I confirm that I am the author of this work and that it has not been submitted to another publication before.

Paper Type: validation/application paper

Primary Subject Area: Application: Radiology

Secondary Subject Area: Detection and Diagnosis

Confidentiality And Author Instructions: I read the call for papers and author instructions. I acknowledge that exceeding the page limit and/or altering the latex template can result in desk rejection.

Code And Data:

Data:
IXI: http://brain-development.org
ADNI: https://ida.loni.usc.edu/
FCP-1000: http://www.nitrc.org/projects/fcon_1000
OASIS: https://www.oasis-brains.org/

Code:
https://github.com/podismine/BrainAgeReg