AT[N]-net: multimodal spatiotemporal network for subtype identification in Alzheimer's disease

Jingwen Zhang, Enze Xu, Minghan Chen

Abstract: Alzheimer's disease (AD) is a heterogeneous, multifactorial neurodegenerative disorder, where beta-amyloid (A), pathologic tau (T), neurodegeneration ([N]), and structural brain network (Net) are four major indicators of AD progression. Most current studies on AD rely on single-source modality and ignore complex biological interactions at molecular level. In this study, we propose a novel multimodal spatiotemporal stratification network (MSSN) that is built upon the fusion of multiple data modalities and the combined power of systems biology and deep learning. Altogether, our stratification approach could (1) ameliorate limitations caused by insufficient longitudinal imaging data, (2) extract important spatiotemporal features vectors from imaging data, (3) exploit the subject-specific longitudinal prediction of a holistic biomarker set, and (4) generate symptoms related finegrained subtype classification.