Which Failure Do You Fear More? Concentration, Containment, and the Closing Observation Window
The governance canon has argued two things it never tested against each other: that concentrating frontier capability in few actors makes coordination tractable, and that layered verification can contain dangerous capability inside a fence. Both rely on a condition neither treats as an independent governance variable: externally usable observability. This paper defines that condition as the observation window — the set of independent, adversarially robust channels through which an external verifier can obtain evidence about a frontier system's capabilities, provenance, deployment configuration and behaviour that is not controlled solely by the system or its operator. Readable reasoning traces were one such channel. Declining chain-of-thought monitorability and rising evaluation awareness are weakening it, and no existing combination of alternative channels has yet been shown to replace the low-cost, high-bandwidth evidence that reasoning traces appeared to provide. The paper makes two claims. First, as native observability declines, concentrated frontier development increasingly requires less-concentrated verification authority: containment carries a verification-diffusion cost, distinct from weight diffusion, in which evidence and access must leave the developer even though the model does not. Second, verification diversity must be measured by failure-mode independence rather than verifier count, since instruments sharing a failure mechanism do not constitute independent observations. Two failures then remain: proliferation, which is comparatively externally legible, and an unchecked frontier, which systematically removes the channels through which it could be checked. The paper argues for fearing the second, because a regime that cannot see cannot correct, and proposes a minimum observability floor negotiated across camps and held partly by parties neither controls. The order of operations is the argument: restore sight before restoring control.
Authors
- Ana (李安娜) Li (ORCID: https://orcid.org/0009-0007-5409-1883)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-09-17
- DOI
- https://doi.org/10.5281/zenodo.22820475
- Primary Topic
- Cybersecurity and Cyber Warfare Studies
- Type
- preprint