Debiased Orthogonal Boundary-driven Efficient Noise Mitigation

Hao Li, Jiayang Gu, Jingkuan Song, An Zhang, Lianli Gao

TL;DR: A debiased orthogonal boundary-driven low-cost model-agnostic noise mitigation paradigm with simple deployment for multiple tasks.

Abstract: Mitigating the detrimental effects of noisy labels on the training process has become increasingly critical, as obtaining entirely clean or human-annotated samples for large-scale pre-training tasks is often impractical. Nonetheless, existing noise mitigation methods often encounter limitations in practical applications due to their task-specific design, model dependency, and significant computational overhead. In this work, we exploit the properties of high-dimensional orthogonality to identify a robust and effective boundary in cone space for separating clean and noisy samples. Building on this, we propose One-Step Anti-noise (OSA), a model-agnostic noisy label mitigation paradigm that employs an estimator model and a scoring function to assess the noise level of input pairs through just one-step inference. We empirically validate the superiority of OSA, demonstrating its enhanced training robustness, improved task transferability, streamlined deployment, and reduced computational overhead across diverse benchmarks, models, and tasks. Our code is released at https://anonymous.4open.science/r/CLIP_OSN-E86C.

Primary Area: Applications->Computer Vision

Keywords: noisy labels, cross-modal matching, noisy correspondences, robust learning, sample selection

Application-Driven Machine Learning: This submission is on Application-Driven Machine Learning.

Submission Number: 9558