Anatomy-guided slice-description interaction for multimodal brain disease diagnosis based on 3D image and radiological report

Open Webpage

Xin Gao, Meihui Zhang, Junjie Li, Shanbo Zhao, Zhizheng Zhuo, Liying Qu, Jinyuan Weng, Li Chai, Yunyun Duan, Chuyang Ye, Yaou Liu

Published: 2025, Last Modified: 02 Aug 2025Comput. Medical Imaging Graph. 2025EveryoneRevisionsBibTeXCC BY-SA 4.0
Abstract: Highlights•Our method first incorporates anatomical priors into multimodal brain diagnosis.•A novel slice-description mechanism enabling fine-grained multimodal interaction.•Our method surpasses competing unimodal and multimodal methods in brain diagnosis.