Monitoring Disease Progression with Stable Diffusion- A Visual Approach

Sourav Kumar, Shell Xu Hu, Aaron S Coyner, Wei-Chun Lin, Susan Ostmo, Deniz Erdogmus, RV Paul Chan, Michael F. Chiang, J. Peter Campbell, Jayashree Kalpathy-cramer, Timothy Hospedales, Praveer Singh

Keywords: Diffusion Models, modelling disease severity, medical image synthesis

Abstract:

Monitoring disease progression is quintessential for effective healthcare by providing early diagnosis, timely interventions and improved patient outcomes. In the recent years, diffusion models have become extremely popular for synthetic medical image generation.
In this work, we combine Stable Diffusion with image editing through textual guidance and cross-attention reweighing to predict disease progression for patients enrolled for a Retinopathy of Prematurity
(ROP) disease screening program. Our technique provides effective visualization for monitoring disease severity over time on new subjects

Submission Number: 154