Generating Pseudo-labels for Car Damage Segmentation Using Deep Spectral Method

Nonthapaht Taspan, Bukorree Madthing, Panumate Chetprayoon, Thanatwit Angsarawanee, Kitsuchart Pasupa, Theerat Sakdejayont

Abstract: Car damage segmentation, an integral part of vehicle damage assessment, involves identifying and classifying various types of damages from images of vehicles, thereby enhancing the efficiency and accuracy of assessment processes. This paper introduces an efficient approach for car damage assessment by combining pseudo-labeling and deep learning techniques. The method addresses the challenge of limited labeled data in car damage segmentation by leveraging unlabeled data. Pseudo-labels are generated using a deep spectral approach and refined through merge and flip-bit operations. Two models, i.e., Mask R-CNN and SegFormer, are trained using a combination of ground truth labels and pseudo-labels. Experimental evaluation of the CarDD dataset demonstrates the superior accuracy of our method, achieving improvements of 12.9% in instance segmentation and 18.8% in semantic segmentation when utilizing a 1/2 ground truth ratio. In addition to enhanced accuracy, our approach offers several benefits, including time savings, cost reductions, and the elimination of biases associated with human judgment. By enabling more precise and reliable identification of car damages, our method enhances the overall effectiveness of the assessment process. The integration of pseudo-labeling and deep learning techniques in car damage assessment holds significant potential for improving efficiency and accuracy in real-world scenarios.