Transformer-Based Hierarchical Clustering for Brain Network Analysis (Extended Abstract)

Wei Dai, Hejie Cui, Xuan Kan, Ying Guo, Carl Yang

Abstract: Brain networks, graphical models such as those constructed from MRI, have been widely used in pathological prediction and analysis of brain functions. Within the complex brain system, differences in neuronal connection strengths parcellate the brain into various functional modules (network communities), which are critical for brain analysis. However, identifying such communities within the brain has been a nontrivial issue due to the complexity of neuronal interactions. In this work, we propose a novel interpretable transformer-based model for joint hierarchical cluster identification and brain network classification with three main contributions. First, we offer an end-to-end transformer-based approach to learning clustering assignments. Through pairwise attention, a clustering layer, BCluster, and a transformer encoder collaboratively learn a globally shared clustering assignment that is continuously tuned to downstream tasks. BCluster enhances the model’s performance and reduces run time complexity while also providing clinical insights. Second, we propose a hierarchical structure for the clustering model, enabling the model to learn more abstract, higher-level cluster representations by combining lower-level modules. Each clustering layer is attached to a distinct readout module, which allows the model to utilize the cluster embeddings of every layer effectively. Last but not least, we redesign the attention mechanism of the transformer with stochastic noise, which enhances its cluster learning capability. We compare our model’s performance with SOTA models and perform clustering analysis with the ground truth community labels. Extensive experimental results show that with the help of hierarchical clustering, the model achieves increased accuracy and reduced runtime complexity while providing plausible insight into the functional organization of brain regions.