AI Meta-Bias: Defining a Second-Order Bias in the Measurement of Artificial Intelligence Systems

This working paper introduces and establishes priority for AI Meta-Bias, a concept first developed and published by the author in December 2025. AI Meta-Bias is a second-order bias located in the measurement frameworks used to evaluate AI systems, not within the systems themselves. It is bias about bias: the assumptions and blind spots built into the tools we use to find AI bias, made permanently invisible by the decision to treat those tools as objective. The paper presents the formal definition, distinguishes the concept from adjacent work including automation bias and algorithmic bias, provides an evidence base drawn from peer-reviewed research and documented cases, and sets out a research proposal for the full empirical paper in preparation. The related concept of the Recursive Bias Paradox, the argument that unbiased AI is conceptually incoherent, is also originated by this author and covered in this deposit.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-12-13
DOI
https://doi.org/10.5281/zenodo.19187753
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AI Meta-Bias: Defining a Second-Order Bias in the Measurement of Artificial Intelligence Systems

Meriel Batterley
Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
article

AI Meta-Bias: Defining a Second-Order Bias in the Measurement of Artificial Intelligence Systems

Meriel Batterley
article en

Abstract

This working paper introduces and establishes priority for AI Meta-Bias, a concept first developed and published by the author in December 2025. AI Meta-Bias is a second-order bias located in the measurement frameworks used to evaluate AI systems, not within the systems themselves. It is bias about bias: the assumptions and blind spots built into the tools we use to find AI bias, made permanently invisible by the decision to treat those tools as objective. The paper presents the formal definition, distinguishes the concept from adjacent work including automation bias and algorithmic bias, provides an evidence base drawn from peer-reviewed research and documented cases, and sets out a research proposal for the full empirical paper in preparation. The related concept of the Recursive Bias Paradox, the argument that unbiased AI is conceptually incoherent, is also originated by this author and covered in this deposit.

Zenodo (CERN European Organization for Nuclear Research)
Peace, Justice and strong institutions
Openalex Percentile: Top 15%
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.