Confidence-aware multi-modality learning for eye disease screening

Ke Zou, Tian Lin, Zongbo Han, Meng Wang, Xuedong Yuan, Haoyu Chen, Changqing Zhang, Xiaojing Shen, Huazhu Fu

Abstract: Highlights•We propose a novel confidence-aware multi-modality eye disease screening method.•We present MoSt to dynamically adapt to heavy-tailed data distributions and capture modality-specific uncertainty.•We introduce an innovative confidence-based ranking regularization term for multi-modal eye disease screening.•We conduct sufficient experiments on the public and in-house datasets with different eye diseases, which clearly verify the accuracy, robustness, and reliability to normal and OOD test samples.