Single Image Test-Time Adaptation for Segmentation

Klara Janouskova, Tamir Shor, Chaim Baskin, Jiri Matas

Abstract:

Test-Time Adaptation methods improve domain shift robustness of deep neural networks.
We explore the adaptation of segmentation models to a single unlabelled image with no other data available at test time. This allows individual sample performance analysis while excluding orthogonal factors such as weight restart strategies. We propose two new segmentation \ac{tta} methods and compare them to established baselines and recent state-of-the-art. The methods are first validated on synthetic domain shifts and then tested on real-world datasets. The analysis highlights that simple modifications such as the choice of the loss function can greatly improve the performance of standard baselines and that different methods and hyper-parameters are optimal for different kinds of domain shift, hindering the development of fully general methods applicable in situations where no prior knowledge about the domain shift is assumed.

Submission Length: Long submission (more than 12 pages of main content)

Changes Since Last Submission:

1. Link to project website and code
2. Fixed typos/grammar issues, minor text revisions to improve clarity

Code: https://github.com/klarajanouskova/SITTA-Segmentation

Assigned Action Editor: ~Ran_He1

Submission Number: 2051