Confusion-Aware Contrastive-Based Semi-Supervised Semantic Change Detection Through Space Collaboration

Qi Guo, Yinhe Liu, Jue Wang, Yanfei Zhong

Abstract: Semantic change detection (SCD) involves detecting changed regions and classifying their corresponding semantic change categories in remote sensing images. However, in most SCD scenarios, only the land-cover category information of the changed regions is provided. The mainstream multitask Siamese network optimization process fails to fully leverage the information from unchanged land-cover types, which limits its ability to recognize land-cover change types and ultimately limits SCD performance. To address the issue of suppressed change type recognition caused by sparse labels in the SCD task, this article proposes a confusion-aware contrastive-based semi-supervised SCD method through space collaboration (SC2A-SCD). The proposed SC2A-SCD framework first integrates bitemporal land-cover classification (LCC)-predicted logits from both the classification and representation spaces using joint classification and representation space modeling (JSM), providing high-quality pseudo-labels for unchanged land-cover types and enhancing the model’s ability to recognize bitemporal land-cover types. Meanwhile, confusion-aware contrastive learning (CACL) is conducted in the representation space, utilizing confusion sampling strategies to sample more confusable anchors and negatives that are prone to misclassification, thereby effectively improving the representation capability of bitemporal land-cover types and enhancing the quality of the pseudo-labels obtained via JSM, ultimately boosting the ability of SC2A-SCD to recognize semantic changes. Compared to the state-of-the-art SCD methods, the comprehensive experimental results confirm that the proposed SC2A-SCD framework can effectively improve the recognition ability for change types, demonstrating its effectiveness in enhancing SCD performance.

External IDs:doi:10.1109/tgrs.2025.3583569