The Epistemic Substitution Error: Why Accurate Algorithmic Decisions Can Still Be Illegitimate

Institutions increasingly rely on algorithmic systems to assess people, allocate opportunities, and justify consequential decisions. Existing debates often ask whether these systems are accurate, fair, transparent, or explainable. This article identifies a distinct philosophical problem: an institution may reach a factually correct outcome while illegitimately replacing a person's standing to offer relevant reasons with an institutional prediction of what those reasons must be. Through analytical reconstruction, contrastive thought experiments, and normative stress tests, the article develops the concept of epistemic substitution, distinguishes predictive evidence from participatory justification, and proposes a non-substitution principle for decisions affecting persons as accountable agents. It demonstrates that prediction, explanation, and even accurate individualized classification do not by themselves establish that affected persons have been appropriately heard. The resulting framework specifies five conditions for legitimate institutional uptake: access, admissibility, responsiveness, traceability, and revisability. It also distinguishes bounded circumstances in which substitution is permissible from those in which it is not, and derives researchable expectations for public administration, employment, education, and automated peer review. The central conclusion is neither that algorithms should never decide nor that personal testimony should automatically prevail. Rather, decision legitimacy requires institutions to preserve the possibility that an affected person can change the reasons on which a decision is made.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-16
DOI
https://doi.org/10.5281/zenodo.23413079
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Epistemic Substitution Error: Why Accurate Algorithmic Decisions Can Still Be Illegitimate

Kwan Hong Tan
Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
article

The Epistemic Substitution Error: Why Accurate Algorithmic Decisions Can Still Be Illegitimate

Kwan Hong Tan
article en

Abstract

Institutions increasingly rely on algorithmic systems to assess people, allocate opportunities, and justify consequential decisions. Existing debates often ask whether these systems are accurate, fair, transparent, or explainable. This article identifies a distinct philosophical problem: an institution may reach a factually correct outcome while illegitimately replacing a person's standing to offer relevant reasons with an institutional prediction of what those reasons must be. Through analytical reconstruction, contrastive thought experiments, and normative stress tests, the article develops the concept of epistemic substitution, distinguishes predictive evidence from participatory justification, and proposes a non-substitution principle for decisions affecting persons as accountable agents. It demonstrates that prediction, explanation, and even accurate individualized classification do not by themselves establish that affected persons have been appropriately heard. The resulting framework specifies five conditions for legitimate institutional uptake: access, admissibility, responsiveness, traceability, and revisability. It also distinguishes bounded circumstances in which substitution is permissible from those in which it is not, and derives researchable expectations for public administration, employment, education, and automated peer review. The central conclusion is neither that algorithms should never decide nor that personal testimony should automatically prevail. Rather, decision legitimacy requires institutions to preserve the possibility that an affected person can change the reasons on which a decision is made.

Zenodo (CERN European Organization for Nuclear Research)
Singapore University of Social Sciences (SG)
Peace, justice, and strong institutions
Openalex Percentile: Top 8%
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.