Everyone Is Hallucinating: How Explainability Masks the Epistemic Failure of Probabilistic AI

Hallucination in large language models is commonly framed as a technical defect—an error to be mitigated through better training, alignment, or post-hoc filtering. This paper argues that such framing fundamentally misunderstands the problem. In probabilistic AI systems that are structurally required to always produce an answer, hallucination is not an anomaly but an expected outcome. The analysis shows that forced answer generation suppresses epistemic uncertainty rather than resolving it. As a result, probabilistic plausibility is routinely mistaken for knowledge. Explainability does not correct this failure. By operating retrospectively, explanatory techniques rationalize outputs after they have already crossed the decision boundary, masking the absence of epistemic justification. The paper develops an epistemic argument for why systems that cannot refuse to answer under conditions of insufficient grounding cannot be trusted to tell the truth. It demonstrates that hallucination, overconfidence, and ungrounded explanations share a common structural cause: the absence of a legitimate non-decision state. Rather than proposing technical solutions, the contribution identifies a necessary precondition for accountable AI. Truthfulness, auditability, and responsibility attribution require that systems possess the authority to withhold judgment. Without this capacity, explainability functions as narrative repair rather than epistemic validation. The paper complements existing work on AI accountability by showing that responsibility cannot be enforced where epistemic non-decision is structurally unavailable. This paper is part of a series examining accountability, auditability, and operational viability in probabilistic and agentic AI systems.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-03-14
DOI
https://doi.org/10.5281/zenodo.19021007
Primary Topic
Explainable Artificial Intelligence (XAI)
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Everyone Is Hallucinating: How Explainability Masks the Epistemic Failure of Probabilistic AI

Thomas Gessler
Zenodo (CERN European Organization for Nuclear Research)
Explainable Artificial Intelligence (XAI)
article

Everyone Is Hallucinating: How Explainability Masks the Epistemic Failure of Probabilistic AI

Thomas Gessler
article en

Abstract

Hallucination in large language models is commonly framed as a technical defect—an error to be mitigated through better training, alignment, or post-hoc filtering. This paper argues that such framing fundamentally misunderstands the problem. In probabilistic AI systems that are structurally required to always produce an answer, hallucination is not an anomaly but an expected outcome. The analysis shows that forced answer generation suppresses epistemic uncertainty rather than resolving it. As a result, probabilistic plausibility is routinely mistaken for knowledge. Explainability does not correct this failure. By operating retrospectively, explanatory techniques rationalize outputs after they have already crossed the decision boundary, masking the absence of epistemic justification. The paper develops an epistemic argument for why systems that cannot refuse to answer under conditions of insufficient grounding cannot be trusted to tell the truth. It demonstrates that hallucination, overconfidence, and ungrounded explanations share a common structural cause: the absence of a legitimate non-decision state. Rather than proposing technical solutions, the contribution identifies a necessary precondition for accountable AI. Truthfulness, auditability, and responsibility attribution require that systems possess the authority to withhold judgment. Without this capacity, explainability functions as narrative repair rather than epistemic validation. The paper complements existing work on AI accountability by showing that responsibility cannot be enforced where epistemic non-decision is structurally unavailable. This paper is part of a series examining accountability, auditability, and operational viability in probabilistic and agentic AI systems.

Zenodo (CERN European Organization for Nuclear Research)
Peace, Justice and strong institutions
Openalex Percentile: Top 25%
Explainable Artificial Intelligence (XAI)
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.