Enhancing fairness in AI-enabled medical systems with the attribute neutral framework
Questions of unfairness and inequity pose critical challenges to the successful deployment of artificial intelligence (AI) in healthcare settings. In AI models, unequal performance across protected groups may be partially attributable to the learning of spurious or otherwise undesirable correlations between sensitive attributes and disease-related information. Here, we introduce the Attribute Neutral Framework, designed to disentangle biased attributes from disease-relevant information and subsequently neutralize them to improve representation across diverse subgroups. Within the framework, we develop the Attribute Neutralizer (AttrNzr) to generate neutralized data, for which protected attributes can no longer be easily predicted by humans or by machine learning classifiers. We then utilize these data to train the disease diagnosis model (DDM). Comparative analysis with other unfairness mitigation algorithms demonstrates that AttrNzr outperforms in reducing the unfairness of the DDM while maintaining DDM's overall disease diagnosis performance. Furthermore, AttrNzr supports the simultaneous neutralization of multiple attributes and demonstrates utility even when applied solely during the training phase, without being used in the test phase. Moreover, instead of introducing additional constraints to the DDM, the AttrNzr directly addresses a root cause of unfairness, providing a model-independent solution. Our results with AttrNzr highlight the potential of data-centered and model-independent solutions for fairness challenges in AI-enabled medical systems.
Authors
- Xiaoting Peng
- Yunfei Gao (ORCID: https://orcid.org/0000-0002-8244-7011)
- Lianting Hu (ORCID: https://orcid.org/0000-0003-4573-3809)
- Chao Xiong
- Xuanhui Chen (ORCID: https://orcid.org/0000-0002-4134-7057)
- Jiajie Tang (ORCID: https://orcid.org/0009-0007-3063-9816)
- Huiying Liang (ORCID: https://orcid.org/0000-0002-9987-8002)
- Xiaohe Bai
- Xueli Zhang (ORCID: https://orcid.org/0000-0001-8306-0639)
- Shuai Huang (ORCID: https://orcid.org/0000-0001-8966-8186)
- Huan Yang (ORCID: https://orcid.org/0009-0001-9504-190X)
- Dantong Li (ORCID: https://orcid.org/0000-0003-1555-0243)
- Huazhang Liu (ORCID: https://orcid.org/0000-0001-5322-7629)
- Peixin Lu (ORCID: https://orcid.org/0000-0003-2602-4898)
- Lingcong Kong (ORCID: https://orcid.org/0000-0001-6884-4005)
Institutions
- Cincinnati Children's Hospital Medical Center (US)
- Army Medical University (CN)
- University of California San Diego (US)
- Xinqiao Hospital (CN)
- Wuhan Children's Hospital (CN)
- Guangdong Academy of Medical Sciences (CN)
- Guangdong Provincial People's Hospital (CN)
- Huazhong University of Science and Technology (CN)
- Southern Medical University (CN)
Publication Details
- Journal
- Nature Communications
- Published
- 2024-10-10
- DOI
- https://doi.org/10.1038/s41467-024-52930-1
- Citations
- 8
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.96
Funders
- National Natural Science Foundation of China
- Guangdong Provincial People's Hospital
- Young Scientists Fund
- National Key Research and Development Program of China
- Basic and Applied Basic Research Foundation of Guangdong Province