Fairness at Risk: Where Bias Emerges in Machine Learning

ABSTRACT Artificial intelligence and machine learning (ML) now shape decisions in healthcare, finance and security, but they can reproduce historical prejudice and inequality. Bias in training data and in model implementation can amplify harm, especially for racial and gender minorities. Despite sustained research on fairness, mitigation in real‐world systems remains uneven, in part because stakeholders lack a shared and precise grasp of core notions, including bias, prejudice, discrimination and fairness. As a result, technical interventions are sometimes adopted without consistent conceptual grounding and reporting. This article addresses that problem by providing a knowledge base that aligns key concepts with empirical evidence and lifecycle stages. We conduct a scoping review to map sources of bias across the ML lifecycle and to identify forms of prejudice and discrimination associated with the use of sensitive attributes. We synthesize qualitative and quantitative evidence and introduce a conceptual model for organizing these findings. Our contributions are threefold: a refined lifecycle taxonomy of bias sources that introduces two additional types and spans all development stages; the explicit treatment of cognitive bias as a cross‐cutting meta‐bias; and an analysis of prejudice and discrimination that compiles a legally grounded catalogue of sensitive attributes and discusses their concepts and issues. Together, these results provide an integrated view of where and how bias emerges, and they support future research, evaluation and governance work on fairness in ML.

Authors

Institutions

Publication Details

Journal
Expert Systems
Published
2026-04-29
DOI
https://doi.org/10.1111/exsy.70265
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Fairness at Risk: Where Bias Emerges in Machine Learning

Marcelo Fantinato, Otávio de Paula Albuquerque, Sarajane Marques Peres
Expert Systems
Artificial Intelligence in Healthcare and Education
article

Fairness at Risk: Where Bias Emerges in Machine Learning

Marcelo Fantinato, Otávio de Paula Albuquerque, Sarajane Marques Peres
article en

Abstract

ABSTRACT Artificial intelligence and machine learning (ML) now shape decisions in healthcare, finance and security, but they can reproduce historical prejudice and inequality. Bias in training data and in model implementation can amplify harm, especially for racial and gender minorities. Despite sustained research on fairness, mitigation in real‐world systems remains uneven, in part because stakeholders lack a shared and precise grasp of core notions, including bias, prejudice, discrimination and fairness. As a result, technical interventions are sometimes adopted without consistent conceptual grounding and reporting. This article addresses that problem by providing a knowledge base that aligns key concepts with empirical evidence and lifecycle stages. We conduct a scoping review to map sources of bias across the ML lifecycle and to identify forms of prejudice and discrimination associated with the use of sensitive attributes. We synthesize qualitative and quantitative evidence and introduce a conceptual model for organizing these findings. Our contributions are threefold: a refined lifecycle taxonomy of bias sources that introduces two additional types and spans all development stages; the explicit treatment of cognitive bias as a cross‐cutting meta‐bias; and an analysis of prejudice and discrimination that compiles a legally grounded catalogue of sensitive attributes and discusses their concepts and issues. Together, these results provide an integrated view of where and how bias emerges, and they support future research, evaluation and governance work on fairness in ML.

Expert SystemsVol. 43(6)
Universidade de São Paulo (BR)
International Business Machines Corporation, Fundação de Amparo à Pesquisa do Estado de São Paulo, Coordenação de Aperfeiçoamento de Pessoal de Nível Superior
Gender equality
Openalex Percentile: Top 11%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.