Adversarial Learning for Semi-Supervised Semantic Segmentation

Wei-Chih Hung, Yi-Hsuan Tsai, Yan-Ting Liou, Yen-Yu Lin, Ming-Hsuan Yang

Abstract: We propose a method for semi-supervised semantic segmentation using the adversarial network. While most existing discriminators are trained to classify input images as real or fake on the image level, we design a discriminator in a fully convolutional manner to differentiate the predicted probability maps from the ground truth segmentation distribution with the consideration of the spatial resolution. We show that the proposed discriminator can be used to improve the performance on semantic segmentation by coupling the adversarial loss with the standard cross entropy loss on the segmentation network. In addition, the fully convolutional discriminator enables the semi-supervised learning through discovering the trustworthy regions in prediction results of unlabeled images, providing additional supervisory signals. In contrast to existing methods that utilize weakly-labeled images, our method leverages unlabeled images without any annotation to enhance the segmentation model. Experimental results on both the PASCAL VOC 2012 dataset and the Cityscapes dataset demonstrate the effectiveness of our algorithm.

Keywords: semantic segmentation, adversarial learning, semi-supervised learning, self-taught learning

Code: [ hfslyc/AdvSemiSeg](https://github.com/hfslyc/AdvSemiSeg) + [ 12 community implementations](https://paperswithcode.com/paper/?openreview=SJQO7UJCW)

Data: [Cityscapes](https://paperswithcode.com/dataset/cityscapes), [SBD](https://paperswithcode.com/dataset/sbd)

Community Implementations: [ 12 code implementations](https://www.catalyzex.com/paper/arxiv:1802.07934/code)