Style Transfer and Pseudo-Label Filtering Improve Transferability in Cell Organelle Segmentation Scenarios

Dmitrii Seletkov, Simon Reiß, Alexander Freytag, Constantin Seibold, Rainer Stiefelhagen

Abstract: Our community has experienced a lot of progress in analyzing biomedical images driven by semantic segmentation solutions. However, the insufficient ability to adapt to new data distributions limits their applicability. As an example, we observed that cell organelle segmentation models can easily drop by more than 60% in relative accuracy when applied to differently imaged cell data. While bridging this gap is possible by collecting new annotations for new data, it is highly repetitive, inefficient, and expensive. In this work, we evaluate how unsupervised and weakly supervised domain adaptation techniques can help to close this gap more efficiently. We answer the questions of how well domain adaptation techniques perform in cell organelle segmentation and whether easy-to-obtain image-level information gives specific benefits. Based on our findings, we propose StyleFilter: a simple and effective approach that uses image-level labels and leads to an observed improvement in 19.2% absolute DICE over the naive transfer baseline in electron microscopy-based domain adaptation for cell organelle segmentation.