A review of deep learning-based information fusion techniques for multimodal medical image classification

Yihao Li, Mostafa El Habib Daho, Pierre-Henri Conze, Rachid Zeghlache, Hugo Le Boité, Ramin Tadayoni, Béatrice Cochener, Mathieu Lamard, Gwenolé Quellec

Abstract: Highlights•Deep learning-based multimodal fusion techniques for medical classification are reviewed.•An up-to-date taxonomy of multimodal information fusion techniques is proposed.•Public datasets of multimodal image classification datasets are reviewed.•A quantitative comparison of multimodal information fusion techniques is performed.•Existing challenges and future trends are discussed.