Enhancing Robustness to Class-Conditional Distribution Shift in Long-Tailed Recognition

Keliang Li, Hong Chang, Shiguang Shan, Xilin CHEN

Abstract: For long-tailed recognition problem, beyond imbalanced label distribution, unreliable empirical data distribution due to instance scarcity has recently emerged as a concern. It inevitably causes Class-Conditional Distribution (CCD) shift between training and test. Data augmentation and head-to-tail information transfer methods indirectly alleviate the problem by synthesizing novel examples but may remain biased. In this paper, we conduct a thorough study on the impact of CCD shift and propose Distributionally Robust Augmentation (DRA) to directly train models robust to the shift. DRA admits a novel generalization bound reflecting the benefit of distributional robustness to CCD shift for long-tailed recognition. Extensive experiments show DRA greatly improves existing re-balancing and data augmentation methods when cooperating with them. It also alleviates the recently discovered saddle-point issue, verifying its ability to achieve enhanced robustness.

Submission Length: Regular submission (no more than 12 pages of main content)

Assigned Action Editor: ~Antoni_B._Chan1

License: Creative Commons Attribution 4.0 International (CC BY 4.0)

Submission Number: 1728