Fairness Artificial Intelligence in Clinical Decision Support: Mitigating Effect of Health Disparity

Published: 25 Sept 2024, Last Modified: 22 Oct 2024IEEE BHI'24EveryoneRevisionsBibTeXCC BY 4.0
Keywords: Causal inference, Fairness, Machine Learning
Abstract: The United States, as well as the global community, experiences health disparities among socially disadvantaged populations. These disparities often manifest in the data utilized for AI model training. Without appropriate de-biasing strategies, models trained to optimize predictive performance may inadvertently capture and perpetuate these inherent biases. The utilization of biased models in clinical decision-making can inflict harm upon patients from disadvantaged groups and exacerbate disparities when these decisions are documented and employed to train subsequent AI models. Unlike conventional correlation-based methods, we aim to mitigate the negative impacts of health disparity by answering a causal inference question for fairness: would the clinical decision support system make a different decision if the patient had a different sensitive attribute (e.g., race, gender)? Recognizing the high computational complexity of developing causal models, we propose a novel causal-model-free algorithm, CFReg, that provides causal fairness for any supervised machine learning model. Specifically, CFReg develops a fairness evaluation metric to assess the fairness of machine learning models in clinical settings. We then validate CFReg using a healthcare dataset of 48,784 patients focused on care management, along with four benchmark supervised learning datasets (law school admission, adult income, criminal recidivism, and violent crime prediction). Experimental results demonstrate that CFReg outperforms baseline approaches in both fairness and accuracy, achieving a good trade-off between fairness and supervised classification performance.
Track: 4. AI-based clinical decision support systems
Registration Id: 3ZN22WR742N
Submission Number: 423
Loading

OpenReview is a long-term project to advance science through improved peer review with legal nonprofit status. We gratefully acknowledge the support of the OpenReview Sponsors. © 2025 OpenReview