Mitigating dataset harms requires stewardship: Lessons from 1000 papersDownload PDF

20 Aug 2021, 23:18 (modified: 07 Nov 2021, 01:50)NeurIPS 2021 Datasets and Benchmarks Track (Round 2)Readers: Everyone
Keywords: datasets, ethics
TL;DR: We analyzed nearly 1000 papers citing three controversial datasets to better understand the ethics of ML datasets.
Abstract: Machine learning datasets have elicited concerns about privacy, bias, and unethical applications, leading to the retraction of prominent datasets such as DukeMTMC, MS-Celeb-1M, and Tiny Images. In response, the machine learning community has called for higher ethical standards in dataset creation. To help inform these efforts, we studied three influential but ethically problematic face and person recognition datasets---Labeled Faces in the Wild (LFW), MS-Celeb-1M, and DukeMTMC---by analyzing nearly 1000 papers that cite them. We found that the creation of derivative datasets and models, broader technological and social change, the lack of clarity of licenses, and dataset management practices can introduce a wide range of ethical concerns. We conclude by suggesting a distributed approach to harm mitigation that considers the entire life cycle of a dataset.
Supplementary Material: zip
URL: Our paper does not present a specific dataset. However, supplemental data (explained in the supplementary material) is available at: https://github.com/citp/mitigating-dataset-harms.
16 Replies

Loading