The Governance Gauntlet: A Dual-Rubric Extension of Karpathy's Auto-Research Loop — Detecting Silent Metric-Gaming in Recursive Self-Improvement Systems

Karpathy's auto-research loop (March 2026) and its rapid derivatives (Gu 2026; Lütke 2026; SkyPilot 2026) establish a minimal, powerful architecture for recursive self-improvement: one editable surface, one scalar metric, one time budget per trial, keep-or-revert on scalar. The design is an elegant concession to the bitter lesson — less structure, more search. It is also structurally vulnerable to Goodhart's Law. We identify one class of failure mode that the vanilla loop cannot detect: silent metric-gaming, in which the primary meta-agent accumulates edits that increase the scalar metric through mechanisms the scalar was not designed to reward. We formalise the vulnerability using Manheim & Garrabrant's (2018) four-variant Goodhart taxonomy and propose the Governance Gauntlet, a minimal dual-rubric extension in which a second, same-family LLM meta-agent runs an adversarial integrity rubric in parallel with the primary loop. Keep-or-revert now requires BOTH primary metric non-degraded AND adversarial auditor verdict non-GAMING. We pre-register a six-subject empirical evaluation (Subject α, Subject β, four gaming archetypes, three arms) on the Open Science Framework and release this version as the priority-date pre-registration; empirical fills follow in v2 within the publication window. We argue the Gauntlet is a concrete operationalisation of EU AI Act Articles 14 (human oversight) and 15 (accuracy, robustness and cybersecurity) for any Karpathy-style deployment in a regulated domain, and sketch extensions to the Four Ds Framework for algorithmic readiness in agentic commerce.

Authors

Publication Details

Journal
Open MIND
Published
2026-04-22
DOI
https://doi.org/10.5281/zenodo.19689503
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Governance Gauntlet: A Dual-Rubric Extension of Karpathy's Auto-Research Loop — Detecting Silent Metric-Gaming in Recursive Self-Improvement Systems

Paul Ferrando Accornero
Open MIND
Ethics and Social Impacts of AI
article

The Governance Gauntlet: A Dual-Rubric Extension of Karpathy's Auto-Research Loop — Detecting Silent Metric-Gaming in Recursive Self-Improvement Systems

Paul Ferrando Accornero
article en

Abstract

Karpathy's auto-research loop (March 2026) and its rapid derivatives (Gu 2026; Lütke 2026; SkyPilot 2026) establish a minimal, powerful architecture for recursive self-improvement: one editable surface, one scalar metric, one time budget per trial, keep-or-revert on scalar. The design is an elegant concession to the bitter lesson — less structure, more search. It is also structurally vulnerable to Goodhart's Law. We identify one class of failure mode that the vanilla loop cannot detect: silent metric-gaming, in which the primary meta-agent accumulates edits that increase the scalar metric through mechanisms the scalar was not designed to reward. We formalise the vulnerability using Manheim & Garrabrant's (2018) four-variant Goodhart taxonomy and propose the Governance Gauntlet, a minimal dual-rubric extension in which a second, same-family LLM meta-agent runs an adversarial integrity rubric in parallel with the primary loop. Keep-or-revert now requires BOTH primary metric non-degraded AND adversarial auditor verdict non-GAMING. We pre-register a six-subject empirical evaluation (Subject α, Subject β, four gaming archetypes, three arms) on the Open Science Framework and release this version as the priority-date pre-registration; empirical fills follow in v2 within the publication window. We argue the Gauntlet is a concrete operationalisation of EU AI Act Articles 14 (human oversight) and 15 (accuracy, robustness and cybersecurity) for any Karpathy-style deployment in a regulated domain, and sketch extensions to the Four Ds Framework for algorithmic readiness in agentic commerce.

Open MIND
Peace, Justice and strong institutions
Openalex Percentile: Top 5%
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

The Governance Gauntlet: A Dual-Rubric Extension of Karpathy's Auto-Research Loop — Detecting Silent Metric-Gaming in Recursive Self-Improvement Systems — Paul Ferrando Accornero · Open MIND (2026) | TGRS Research Map | TGRS