MagNet: Multi-Level Attention Graph Network for Predicting High-Resolution Spatial Transcriptomics

Junchao Zhu, Ruining Deng, Tianyuan Yao, Juming Xiong, Chongyu Qu, Junlin Guo, Siqi Lu, Yucheng Tang, Daguang Xu, Mengmeng Yin, Yu Wang, Shilin Zhao, Yaohong Wang, Haichun Yang, Yuankai Huo

Keywords: Spatial Transcriptomics, Computational Pathology, Medical Image Analysis

TL;DR: In this paper, we introduce MagNet, a multi-level attention graph network designed for accurate prediction of high-resolution spatial transcriptomics.

Abstract: The rapid development of spatial transcriptomics (ST) offers new opportunities to explore the gene expression patterns within the spatial microenvironment. Current research integrates pathological images to infer gene expression, addressing the high costs and time-consuming processes to generate spatial transcriptomics data. However, as spatial transcriptomics resolution continues to improve, existing methods remain primarily focused on gene expression prediction at low-resolution (55𝜇m) spot levels. These methods face significant challenges, especially the information bottleneck, when they are applied to high-resolution (8𝜇m) HD data. To bridge this gap, this paper introduces MagNet, a multi-level attention graph network designed for accurate prediction of high-resolution HD data. MagNet employs cross-attention layers to integrate features from multi-resolution image patches hierarchically and utilizes a GAT-Transformer module to aggregate neighborhood information. By integrating multilevel features, MagNet overcomes the limitations posed by low-resolution inputs in predicting high-resolution gene expression. We systematically evaluated MagNet and existing ST prediction models on both a private spatial transcriptomics dataset and a public dataset at three different resolution levels. The results demonstrate that MagNet achieves state-of-the-art performance at both spot level and high-resolution bin levels, providing a novel methodology and benchmark for future research and applications in high-resolution HD-level spatial transcriptomics. Code is available at https://github.com/Junchao-Zhu/MagNet.

Primary Subject Area: Application: Histopathology

Secondary Subject Area: Application: Other

Paper Type: Both

Registration Requirement: Yes

Reproducibility: https://github.com/Junchao-Zhu/MagNet

Visa & Travel: Yes

Submission Number: 10