Improving radiology report generation with multi-grained abnormality prediction

Yuda Jin, Weidong Chen, Yuanhe Tian, Yan Song, Chenggang Yan

Abstract: Highlights•Multi-grained abnormality prediction is designed to alleviate the data-driven problem•The proposed dual-stream adaptive decoder can adaptively generates reports•Reinforcement learning is used to alleviate the decoder consistency problem