A Deep Dive into Dataset Imbalance and Bias in Face Identification

Valeriia Cherepanova, Steven Reich, Samuel Dooley, Hossein Souri, John P Dickerson, Micah Goldblum, Tom Goldstein

Keywords: face recognition, dataset imbalance, bias, fairness

TL;DR: In this work, we explore the effects of different kinds of data imbalance on bias in face identification problem.

Abstract: As the deployment of automated face recognition (FR) systems proliferates, bias in these systems is not just an academic question, but a matter of public concern. Media portrayals often center imbalance as the main source of bias, i.e., that FR models perform worse on images of non-white people or women because these demographic groups are underrepresented in training data. Recent academic research paints a more nuanced picture of this relationship. However, previous studies of data imbalance in FR have focused exclusively on the face verification setting, while the face identification setting has been largely ignored, despite being deployed in sensitive applications such as law enforcement. This is an unfortunate omission, as 'imbalance' is a more complex matter in identification; imbalance may arise in not only the training data, but also the testing data, and furthermore may affect the proportion of identities belonging to each demographic group or the number of images belonging to each identity. In this work, we address this gap in the research by thoroughly exploring the effects of each kind of imbalance possible in face identification, and discuss other factors which may impact bias in this setting.

Community Implementations: [ 1 code implementation](https://www.catalyzex.com/paper/arxiv:2203.08235/code)