Chest-OMDL: Organ-specific Multidisease Detection and Localization in Chest Computed Tomography using Weakly Supervised Deep Learning from Free-text Radiology Report

Xuguang Bai, Mingxuan Liu, Yifei Chen, Hongjia Yang, Qiyuan Tian

Keywords: Radiology report, Chest computed tomography, Weakly supervised learning, Multidisease detection

TL;DR: Chest-OMDL is a weakly supervised framework for chest CT that reduces annotation costs in multidisease detection and localization.

Abstract: Deep learning (DL) models designed to detect abnormalities in chest computed tomography (CT) reduce radiologists’ workload. However, training multidisease diagnostic models requires large expert-annotated datasets, significantly increasing model development cost. To address this challenge, we propose a weakly supervised learning (WSL) framework entitled Chest-OMDL for Organ-specific Multidisease Detection and Localization in chest CT. Chest-OMDL trains DL models using disease labels extracted by RadBERT from free-text radiology reports and multi-organ segmentation masks generated by the Segment Anything by Text (SAT) model, therefore reducing the need for manual annotation. Specifically, Chest-OMDL employs a Y-shaped Mamba model (Y-Mamba), comprising a feature extractor, an organ segmentation decoder, and a disease anomaly map generator. By incorporating multidisease anatomical knowledge, Y-Mamba is trained with a multi-task loss for organ-level weak supervision. Chest-OMDL was trained and validated on the large-scale CT-RATE dataset (25,692 non-contrast 3D chest CT scans from 21,304 patients) and tested on the external RAD-ChestCT dataset (3,630 scans), outperforming CT-CLIP (contrastive language-image pre-training) and CT-Net (full supervision). The proposed Chest-OMDL can be applied to multiple anatomical sites, potentially streamlining diagnostics.

Primary Subject Area: Detection and Diagnosis

Secondary Subject Area: Application: Radiology

Paper Type: Both

Registration Requirement: Yes

Reproducibility: Code and the pre-trained model will be publicly released upon acceptance.

Visa & Travel: Yes

Submission Number: 37