SelMix: Selective Mixup Fine Tuning for Optimizing Non-Decomposable Metrics

Shrinivas Ramasubramanian, Harsh Rangwani, Sho Takemori, Kunal Samanta, Yuhei Umeda, Venkatesh Babu Radhakrishnan

Keywords: Non-Decomposable Metrics, Long-Tail learning, Semi-supervised learning

TL;DR: SelMix is a fine-tuning technique that can be used to optimize a machine learning models performance on a specific non-decomposable metric on imbalanced data

Abstract:

Natural data often has class imbalance. This can make it difficult for machine learning models to learn to classify minority classes accurately. In-
dustrial machine-learning applications often have objectives beyond just accuracy. For example, models may be required to meet certain fairness criteria, such as not being biased against the classes with fewer samples. These objectives are often non-decomposable in nature. SelMix is a fine-tuning technique that can be used to improve the performance of machine learning models on imbalanced data. The core idea of our framework is to determine a sampling distribution to perform
a mixup of features between samples from particular classes such that it optimizes the given objective. We evaluate our technique against the existing empirical methods on standard benchmark datasets for imbalanced classification.

Submission Number: 28