Generating multi-pathological and multi-modal images and labels for brain MRI

Virginia Fernandez, Walter Hugo Lopez Pinaya, Pedro Borges, Mark S. Graham, Petru-Daniel Tudosiu, Tom Vercauteren, M. Jorge Cardoso

Abstract: Highlights•2D and 3D paired labels and multi-modal images are synthesised end-to-end.•Conditioning enables synthesis of lesions and extrapolation to unseen combinations.•Synthetic datasets can be used to supplement small real datasets for segmentation.•Synthetic datasets improve generalisability to other domains and unseen lesions.•Privacy analysis shows no memorisation of training datasets.