Beyond AGI (Verification Intelligence series, Paper 8 of 12)

The artificial general intelligence research programme rests on an implicit equation: more capability produces more intelligence, and more intelligence produces better outcomes. This paper tests that equation against the evidence and finds it structurally unsound. The first link holds. Capability improvements do correspond to something that can reasonably be called intelligence — current frontier models reason with genuine sophistication across an extraordinary range of domains. The second link is broken. Enterprise failure rates, incident acceleration, and rework costs have remained stubbornly consistent through years of dramatic capability improvement. Intelligence does not produce better outcomes without verification infrastructure. This paper develops two arguments not made elsewhere in the series. The first is that capability and reliability are not merely uncorrelated but, in specific and consequential dimensions, inversely correlated — more capability actively produces less verifiability, less human oversight capacity, and greater potential for consequential undetected error. The inverse correlation operates through four identifiable channels (fluency, autonomy, confidence, and consequence), each of which intensifies as capability increases. The second is that the investment thesis underlying the AGI race — recursive capability gains producing superintelligence producing extraordinary value — has a structural flaw identical to the one that produced the 2008 financial crisis: recursive optimisation for internal metrics without verification against external reality. Others have recognised the verification gap from different angles: Anthropic's constitutional AI constrains model behaviour at training time; the EU AI Act mandates conformity assessment for high-risk systems; AVERI is building evaluation standards; Vitalik Buterin has proposed AI-assisted formal verification for code. Each addresses a real dimension of the problem. This paper examines the structural trajectory of the capability-only paradigm — the case that capability pursued as the sole objective produces a characteristic failure pattern in which systems become progressively more capable and progressively less trustworthy. The alternative paradigm — Verification Intelligence and Recursive General Intelligence — is described in the Verification Intelligence (Paper 4) and the Verification Substrate (Paper 5). This paper confines itself to the case against the current trajectory. ---

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-06-29
DOI
https://doi.org/10.5281/zenodo.20973212
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Beyond AGI (Verification Intelligence series, Paper 8 of 12)

Darren Wright
Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
article

Beyond AGI (Verification Intelligence series, Paper 8 of 12)

Darren Wright
article en

Abstract

The artificial general intelligence research programme rests on an implicit equation: more capability produces more intelligence, and more intelligence produces better outcomes. This paper tests that equation against the evidence and finds it structurally unsound. The first link holds. Capability improvements do correspond to something that can reasonably be called intelligence — current frontier models reason with genuine sophistication across an extraordinary range of domains. The second link is broken. Enterprise failure rates, incident acceleration, and rework costs have remained stubbornly consistent through years of dramatic capability improvement. Intelligence does not produce better outcomes without verification infrastructure. This paper develops two arguments not made elsewhere in the series. The first is that capability and reliability are not merely uncorrelated but, in specific and consequential dimensions, inversely correlated — more capability actively produces less verifiability, less human oversight capacity, and greater potential for consequential undetected error. The inverse correlation operates through four identifiable channels (fluency, autonomy, confidence, and consequence), each of which intensifies as capability increases. The second is that the investment thesis underlying the AGI race — recursive capability gains producing superintelligence producing extraordinary value — has a structural flaw identical to the one that produced the 2008 financial crisis: recursive optimisation for internal metrics without verification against external reality. Others have recognised the verification gap from different angles: Anthropic's constitutional AI constrains model behaviour at training time; the EU AI Act mandates conformity assessment for high-risk systems; AVERI is building evaluation standards; Vitalik Buterin has proposed AI-assisted formal verification for code. Each addresses a real dimension of the problem. This paper examines the structural trajectory of the capability-only paradigm — the case that capability pursued as the sole objective produces a characteristic failure pattern in which systems become progressively more capable and progressively less trustworthy. The alternative paradigm — Verification Intelligence and Recursive General Intelligence — is described in the Verification Intelligence (Paper 4) and the Verification Substrate (Paper 5). This paper confines itself to the case against the current trajectory. ---

Zenodo (CERN European Organization for Nuclear Research)
LabCorp (United States) (US)
Industry, innovation and infrastructure
Openalex Percentile: Top 7%
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.