Artificial intelligence accelerates multi-modal biomedical process: A Survey

Jiajia Li, Xue Han, Yiming Qin, Feng Tan, Yulong Chen, Zikai Wang, Haitao Song, Xi Zhou, Yuan Zhang, Lun Hu, Pengwei Hu

Abstract: Highlights•Multi-modal medical AI aims to process and link diverse data types to benefit healthcare and society.•Various data pre-processing methods are outlined to prepare multi-modal data for model training.•Multi-modal data fusion strategies are discussed, including data-level, feature-level, decision-level, and model-level fusion.•Several multi-modal applications and related biomedical tasks are summarized.•The paper highlights future challenges in technology, data, and privacy.