Self-Supervised Surface Defect Localization via Joint De-Anomaly Reconstruction and Saliency-Guided Segmentation

Hanyue Yang, Zhenfeng Zhu, Chen Lin, Wenjun Hui, Shenghui Wang, Yao Zhao

Abstract: Anomaly localization plays one of the significant role in practical industrial applications but still faces some unique challenges due to the rarity and diversity of anomalies. To address this issue, we propose a self-supervised surface defect localization method via joint de-anomaly reconstruction and saliency-guided segmentation, also named JDRSS. Considering the severe lack of anomalous images, an approach for synthesizing anomalous samples is proposed to simulate different types of anomalies, which results in a variety of realistic and diverse anomalous images. To promote the reconstruction quality to the normal reference, we develop a novel autoencoder-based reconstruction network by applying the bundled de-anomaly constraint to refrain both the embedding space and the reconstruction space from the interference of abnormality. Furthermore, in order to accurately localize the surface defect, an anomalous saliency map-guided segmentation network is proposed, in which the residuals from the reconstructed image and input are dexterously injected into each segmentation layer as spatial attention, thus enhancing the sensitivity to anomalies. We have conducted extensive experiments on the MVTec anomaly detection (MVTec AD) dataset and the proposed model achieves considerable performance for different classes of anomaly localization.