Generating synthetic clinical text with local large language models to identify misdiagnosed limb fractures in radiology reports

Jinghui Liu, Bevan Koopman, Nathan J. Brown, Kevin Chu, Anthony N. Nguyen

Abstract: Highlights•Popular open-source LLMs were compared with proprietary LLMs in generating synthetic radiology reports.•Synthetic reports were applied to train downstream report classification models to identify misdiagnosed limb fractures.•Open-source LLMs can achieve similar performances as proprietary LLMs in generating reports with high predictive value.•Impact of reports from different hospital sources were investigated and directions for further research were identified.