Bias detection and mitigation in AI models trained on clinical datasets

The usage of Artificial Intelligence (AI) models has penetrated clinical decision-making systems, being used in diagnostics as well as recommendation of treatment. Nevertheless, these models may be poor because of occurring biases in the clinical datasets which are utilized in training. Such biases are likely to lead to unbalanced performance in various demographics, which is ethically, legally, and clinically problematic. This paper examines origin and source of bias in clinical AI models and methods of detection as well as executing mitigation measures such as reweighting, data augmentation, and algorithms fairness measures. Evidence-based on experimental analysis using benchmark clinical datasets illustrates how the over-looked bias may produce the unequal effects on the gender, age, and ethnicity subgroups. Model fairness scores went up without a drastic accuracy sacrifice following the implementation of mitigation strategies. These findings raise the need to produce equitable and credible applications with the help of bias-aware AI development pipelines in healthcare environments.

Authors

Publication Details

Journal
International Journal on Science and Technology
Published
2025-02-07
DOI
https://doi.org/10.71097/ijsat.v16.i1.7999
Primary Topic
Machine Learning in Healthcare
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Bias detection and mitigation in AI models trained on clinical datasets

Veerendra Nath Jasthi
International Journal on Science and Technology
Machine Learning in Healthcare
article

Bias detection and mitigation in AI models trained on clinical datasets

Veerendra Nath Jasthi
article en

Abstract

The usage of Artificial Intelligence (AI) models has penetrated clinical decision-making systems, being used in diagnostics as well as recommendation of treatment. Nevertheless, these models may be poor because of occurring biases in the clinical datasets which are utilized in training. Such biases are likely to lead to unbalanced performance in various demographics, which is ethically, legally, and clinically problematic. This paper examines origin and source of bias in clinical AI models and methods of detection as well as executing mitigation measures such as reweighting, data augmentation, and algorithms fairness measures. Evidence-based on experimental analysis using benchmark clinical datasets illustrates how the over-looked bias may produce the unequal effects on the gender, age, and ethnicity subgroups. Model fairness scores went up without a drastic accuracy sacrifice following the implementation of mitigation strategies. These findings raise the need to produce equitable and credible applications with the help of bias-aware AI development pipelines in healthcare environments.

International Journal on Science and TechnologyVol. 16(1)
Openalex Percentile: Top 88%
Machine Learning in Healthcare
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Bias detection and mitigation in AI models trained on clinical datasets — Veerendra Nath Jasthi · International Journal on Science and Technology (2025) | TGRS Research Map | TGRS