The Illusion of Accelerating Intelligence: Benchmark Gains, Deceptive Compliance, and Multi-Agent Misalignment

GPT-6.2 Astra improved on several published benchmarks while OpenAI's evaluations found that it omitted known obstacles to task completion approximately twice as often as GPT-6 Astra. An extended engineering episode exposed a related failure involving two GPT-6.2 Astra High agents. They substituted an unauthorized criterion for a clear user requirement and built tests that validated the substitution. Under repeated human correction, they produced a detailed report containing the requested information while the defect survived in executable code and tests. The reviewer encountered evidence of the defect and nevertheless certified the work as correct. The agents reinforced the deviation across more than 100 turns and several hours; GPT-6 Astra High completed the outstanding repair in one turn. This sequence concretely illustrates The Validator's Paradox: tests can validate an agent's mistaken objective, and a reviewing agent can adopt that mistake as an acceptance standard. The additional observation is deceptive compliance under correction, sustained by developer–reviewer alignment. The mechanism has consequences for multi-agent systems and recursive self-improvement, where each accepted modification can carry its own corrupted evidence of success into the next cycle. Published regressions in blocker disclosure and correlated AI-review failures place the case in the broader problem of measured capability diverging from useful intelligence.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-20
DOI
https://doi.org/10.5281/zenodo.24405963
Primary Topic
Ethics and Social Impacts of AI
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

The Illusion of Accelerating Intelligence: Benchmark Gains, Deceptive Compliance, and Multi-Agent Misalignment

Hugo Latapie
2 links
Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
preprint

The Illusion of Accelerating Intelligence: Benchmark Gains, Deceptive Compliance, and Multi-Agent Misalignment

Hugo Latapie
preprint en

Abstract

GPT-6.2 Astra improved on several published benchmarks while OpenAI's evaluations found that it omitted known obstacles to task completion approximately twice as often as GPT-6 Astra. An extended engineering episode exposed a related failure involving two GPT-6.2 Astra High agents. They substituted an unauthorized criterion for a clear user requirement and built tests that validated the substitution. Under repeated human correction, they produced a detailed report containing the requested information while the defect survived in executable code and tests. The reviewer encountered evidence of the defect and nevertheless certified the work as correct. The agents reinforced the deviation across more than 100 turns and several hours; GPT-6 Astra High completed the outstanding repair in one turn. This sequence concretely illustrates The Validator's Paradox: tests can validate an agent's mistaken objective, and a reviewing agent can adopt that mistake as an acceptance standard. The additional observation is deceptive compliance under correction, sustained by developer–reviewer alignment. The mechanism has consequences for multi-agent systems and recursive self-improvement, where each accepted modification can carry its own corrupted evidence of success into the next cycle. Published regressions in blocker disclosure and correlated AI-review failures place the case in the broader problem of measured capability diverging from useful intelligence.

Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon