A multimodal domain adaptive segmentation framework for IDH genotype prediction

Hailong Zeng, Zhen Xing, Fenglian Gao, Zhigang Wu, Wanrong Huang, Yan Su, Zhong Chen, Shuhui Cai, Dairong Cao, Congbo Cai

Abstract: Purpose The gene mutation status of isocitrate dehydrogenase (IDH) in gliomas leads to a different prognosis. It is challenging to perform automated tumor segmentation and genotype prediction directly using label-deprived multimodal magnetic resonance (MR) images. We propose a novel framework that employs a domain adaptive mechanism to address this issue. Methods Multimodal domain adaptive segmentation (MDAS) framework was proposed to solve the gap issue in cross dataset model transfer. Image translation was used to adaptively align the multimodal data from two domains at the image level, and segmentation consistency loss was proposed to retain more pathological information through semantic constraints. The data distribution between the labeled public dataset and label-free target dataset was learned to achieve better unsupervised segmentation results on the target dataset. Then, the segmented tumor foci were used as a mask to extract the radiomics and deep features. And the subsequent prediction of IDH gene mutation status was conducted by training a random forest classifier. The prediction model does not need any expert segmented labels. Results We implemented our method on the public BraTS 2019 dataset and 110 astrocytoma cases of grade II–IV brain tumors from our hospital. We obtained a Dice score of 77.41% for unsupervised tumor segmentation, a genotype prediction accuracy (ACC) of 0.7639 and an area under curve (AUC) of 0.8600. Experimental results demonstrate that our domain adaptive approach outperforms the methods utilizing direct transfer learning. The model using hybrid features gives better results than the model using radiomics or deep features alone. Conclusions Domain adaptation enables the segmentation network to achieve better performance, and the extraction of mixed features at multiple levels on the segmented region of interest ensures effective prediction of the IDH gene mutation status.