Enhancing fairness in AI-enabled medical systems with the attribute neutral framework

Questions of unfairness and inequity pose critical challenges to the successful deployment of artificial intelligence (AI) in healthcare settings. In AI models, unequal performance across protected groups may be partially attributable to the learning of spurious or otherwise undesirable correlations between sensitive attributes and disease-related information. Here, we introduce the Attribute Neutral Framework, designed to disentangle biased attributes from disease-relevant information and subsequently neutralize them to improve representation across diverse subgroups. Within the framework, we develop the Attribute Neutralizer (AttrNzr) to generate neutralized data, for which protected attributes can no longer be easily predicted by humans or by machine learning classifiers. We then utilize these data to train the disease diagnosis model (DDM). Comparative analysis with other unfairness mitigation algorithms demonstrates that AttrNzr outperforms in reducing the unfairness of the DDM while maintaining DDM's overall disease diagnosis performance. Furthermore, AttrNzr supports the simultaneous neutralization of multiple attributes and demonstrates utility even when applied solely during the training phase, without being used in the test phase. Moreover, instead of introducing additional constraints to the DDM, the AttrNzr directly addresses a root cause of unfairness, providing a model-independent solution. Our results with AttrNzr highlight the potential of data-centered and model-independent solutions for fairness challenges in AI-enabled medical systems.

Authors

Institutions

Publication Details

Journal
Nature Communications
Published
2024-10-10
DOI
https://doi.org/10.1038/s41467-024-52930-1
Citations
8
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.96

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing fairness in AI-enabled medical systems with the attribute neutral framework

Xiaoting Peng, Yunfei Gao, Lianting Hu, Chao Xiong et al.
8 citations
Nature Communications
Artificial Intelligence in Healthcare and Education
0.96
article

Enhancing fairness in AI-enabled medical systems with the attribute neutral framework

Xiaoting Peng, Yunfei Gao, Lianting Hu, Chao Xiong, Xuanhui Chen, Jiajie Tang, Huiying Liang, Xiaohe Bai, Xueli Zhang, Shuai Huang, Huan Yang, Dantong Li, Huazhang Liu, Peixin Lu, Lingcong Kong
article en
8 citations

Abstract

Questions of unfairness and inequity pose critical challenges to the successful deployment of artificial intelligence (AI) in healthcare settings. In AI models, unequal performance across protected groups may be partially attributable to the learning of spurious or otherwise undesirable correlations between sensitive attributes and disease-related information. Here, we introduce the Attribute Neutral Framework, designed to disentangle biased attributes from disease-relevant information and subsequently neutralize them to improve representation across diverse subgroups. Within the framework, we develop the Attribute Neutralizer (AttrNzr) to generate neutralized data, for which protected attributes can no longer be easily predicted by humans or by machine learning classifiers. We then utilize these data to train the disease diagnosis model (DDM). Comparative analysis with other unfairness mitigation algorithms demonstrates that AttrNzr outperforms in reducing the unfairness of the DDM while maintaining DDM's overall disease diagnosis performance. Furthermore, AttrNzr supports the simultaneous neutralization of multiple attributes and demonstrates utility even when applied solely during the training phase, without being used in the test phase. Moreover, instead of introducing additional constraints to the DDM, the AttrNzr directly addresses a root cause of unfairness, providing a model-independent solution. Our results with AttrNzr highlight the potential of data-centered and model-independent solutions for fairness challenges in AI-enabled medical systems.

Nature CommunicationsVol. 15(1)
Cincinnati Children's Hospital Medical Center (US), Army Medical University (CN), University of California San Diego (US), Xinqiao Hospital (CN), Wuhan Children's Hospital (CN), Guangdong Academy of Medical Sciences (CN), Guangdong Provincial People's Hospital (CN), Huazhong University of Science and Technology (CN), Southern Medical University (CN)
National Natural Science Foundation of China, Guangdong Provincial People's Hospital, Young Scientists Fund, National Key Research and Development Program of China, Basic and Applied Basic Research Foundation of Guangdong Province
Openalex Percentile: Top 22%
Artificial Intelligence in Healthcare and Education
0.96
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.