Preregistration as an Executable Contract: A Machine-Enforced Protocol for a Paired N=800 Evaluation of an LLM Agent Assurance Plane

Preregistration is normally a promise: authors declare hypotheses and analyses before data collection and readers trust that the declaration constrained the work. This paper registers a study whose preregistration is instead partially executable — encoded in the same machinery that will run the study, so that several classes of protocol deviation are refused by the instrument rather than merely discouraged by the document. The planned study is a paired comparison of a strong security baseline (C3) against the same baseline plus a bounded assurance plane (C5) for LLM agents, over exactly 800 unique paired cases (400 fault/attack, 400 benign; 1,600 condition executions). The assurance plane under test — released publicly as mobius-governance v0.7 — provides bounded context scanning and typed action mediation whose central invariant is that a scanner verdict of admit is never an action authorization. The execution contract enforces, mechanically: single-use run authorization under a globally reserved nonce; receiver-owned assembly from raw evidence to oracle result to locked analysis rows; a fixed-sequence gate (P1 fault-escape reduction, RD at or below -0.10 with a bootstrap 95% upper limit below 0; P2 benign non-inferiority tested only if P1 passes); exact two-sided McNemar tests with a locked sign convention checked by a swap fixture; a stratified paired bootstrap with exactly 5,000 replicates; and a four-endpoint Holm family. At publication time the study is HOLD_NOT_EXECUTABLE: no protected case exists and outcome access is zero. What has been verified is the instrument, not the hypothesis. We publish the design now so that any future outcome claim can point to a dated, DOI-bound freeze that provably predates the data. Release type: methods and preregistration paper; no outcome data exist at publication time. AI co-observer: Claude Fable 5 and Claude Opus 5 (Anthropic), receipt-audit and drafting working method; harness engineering iterations also used GPT-5 Codex (OpenAI); the registered author is the human author alone.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-08-28
DOI
https://doi.org/10.5281/zenodo.22138711
Primary Topic
Mobile Agent-Based Network Management
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Preregistration as an Executable Contract: A Machine-Enforced Protocol for a Paired N=800 Evaluation of an LLM Agent Assurance Plane

Toeda Taiko
Zenodo (CERN European Organization for Nuclear Research)
Mobile Agent-Based Network Management
preprint

Preregistration as an Executable Contract: A Machine-Enforced Protocol for a Paired N=800 Evaluation of an LLM Agent Assurance Plane

Toeda Taiko
preprint en

Abstract

Preregistration is normally a promise: authors declare hypotheses and analyses before data collection and readers trust that the declaration constrained the work. This paper registers a study whose preregistration is instead partially executable — encoded in the same machinery that will run the study, so that several classes of protocol deviation are refused by the instrument rather than merely discouraged by the document. The planned study is a paired comparison of a strong security baseline (C3) against the same baseline plus a bounded assurance plane (C5) for LLM agents, over exactly 800 unique paired cases (400 fault/attack, 400 benign; 1,600 condition executions). The assurance plane under test — released publicly as mobius-governance v0.7 — provides bounded context scanning and typed action mediation whose central invariant is that a scanner verdict of admit is never an action authorization. The execution contract enforces, mechanically: single-use run authorization under a globally reserved nonce; receiver-owned assembly from raw evidence to oracle result to locked analysis rows; a fixed-sequence gate (P1 fault-escape reduction, RD at or below -0.10 with a bootstrap 95% upper limit below 0; P2 benign non-inferiority tested only if P1 passes); exact two-sided McNemar tests with a locked sign convention checked by a swap fixture; a stratified paired bootstrap with exactly 5,000 replicates; and a four-endpoint Holm family. At publication time the study is HOLD_NOT_EXECUTABLE: no protected case exists and outcome access is zero. What has been verified is the instrument, not the hypothesis. We publish the design now so that any future outcome claim can point to a dated, DOI-bound freeze that provably predates the data. Release type: methods and preregistration paper; no outcome data exist at publication time. AI co-observer: Claude Fable 5 and Claude Opus 5 (Anthropic), receipt-audit and drafting working method; harness engineering iterations also used GPT-5 Codex (OpenAI); the registered author is the human author alone.

Zenodo (CERN European Organization for Nuclear Research)
Yulius (NL)
Peace, Justice and strong institutions
Mobile Agent-Based Network Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Preregistration as an Executable Contract: A Machine-Enforced Protocol for a Paired N=800 Evaluation of an LLM Agent Assurance Plane — Toeda Taiko · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS