Flood Segmentation on Sentinel-1 SAR Imagery with Semi-Supervised Learning

Sayak Paul, Siddha Ganju

Keywords: flood segmentation, semantic segmentation, semi-supervised learning, pseudo-labeling

TL;DR: We propose a semi-supervised learning pseudo-labeling scheme that derives confidence estimates from U-Net ensembles and achieves state of the art on the Sentinel-1 dataset.

Abstract: Floods wreak havoc throughout the world, causing billions of dollars in damages, and uprooting communities, ecosystems and economies. The NASA Impact Emerging Techniques in Computational Intelligence (ETCI) competition on Flood Detection tasked participants with predicting flooded pixels after training with synthetic aperture radar (SAR) images in a supervised setting. We propose a semi-supervised learning pseudo-labeling scheme that derives confidence estimates from U-Net ensembles, thereby progressively improving accuracy. Concretely, we use a cyclical approach involving multiple stages (1) training an ensemble model of multiple U-Net architectures with the provided high confidence hand-labeled data and, generated pseudo labels or low confidence labels on the entire unlabeled test dataset, and then, (2) filter out quality generated labels and, (3) combine the generated labels with the previously available high confidence hand-labeled dataset. This assimilated dataset is used for the next round of training ensemble models. This cyclical process is repeated until the performance improvement plateaus. Additionally, we post process our results with Conditional Random Fields. Our approach sets a high score, and a new state-of-the-art on the Sentinel-1 dataset for the ETCI competition with 0.7654 IoU, an impressive improvement over the 0.60 IOU baseline. Our method, which we release with all the code including trained models, can also be used as an open science benchmark for the Sentinel-1 released dataset.

Track: Original Research Track

Community Implementations: [ 1 code implementation](https://www.catalyzex.com/paper/flood-segmentation-on-sentinel-1-sar-imagery/code)