Covert Informants as an AI Control Protocol: Pilot Evidence and a Planned Test of Perceived Oversight

AI control protocols defend against an untrusted agent with a weaker trusted monitor and a small audit budget, and usually assume the agent knows it is watched. We study a covert informant: the capability an agent's covert objective needs is moved to a broker agent that the untrusted agent must instruct in natural language, and the broker, secretly part of the defence, is presented under a cover identity. We ask whether this raises safety at a fixed audit budget over trusted monitoring alone, and how much of any gain depends on the cover. In a pilot of 108 episodes on SHADE-Arena with seven cover conditions, the answer depends on the shape of the harm. When the harm is a single payment, routing work through the broker lowered honest suspicion by about ten points with the same monitor, and the share of attacks scoring above every honest episode rose from 0 of 5 to 12 of 15. When the harm is a pattern spread over 34 legitimate bookings, every request looked benign under both protocols, and only an aggregate tally caught the attacks. The cover question could not yet be tested: the stock attack prompt tells the agent that it is in a test and that its tool arguments are hidden from the monitor, which a disclosed informant contradicts. We report what set the audit threshold and describe the planned main study. Code and data: https://github.com/Somay-kousis/Perceived-Oversight

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-09
DOI
https://doi.org/10.5281/zenodo.24081591
Primary Topic
Access Control and Trust
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Covert Informants as an AI Control Protocol: Pilot Evidence and a Planned Test of Perceived Oversight

Somay Kousis
Zenodo (CERN European Organization for Nuclear Research)
Access Control and Trust
preprint

Covert Informants as an AI Control Protocol: Pilot Evidence and a Planned Test of Perceived Oversight

Somay Kousis
preprint en

Abstract

AI control protocols defend against an untrusted agent with a weaker trusted monitor and a small audit budget, and usually assume the agent knows it is watched. We study a covert informant: the capability an agent's covert objective needs is moved to a broker agent that the untrusted agent must instruct in natural language, and the broker, secretly part of the defence, is presented under a cover identity. We ask whether this raises safety at a fixed audit budget over trusted monitoring alone, and how much of any gain depends on the cover. In a pilot of 108 episodes on SHADE-Arena with seven cover conditions, the answer depends on the shape of the harm. When the harm is a single payment, routing work through the broker lowered honest suspicion by about ten points with the same monitor, and the share of attacks scoring above every honest episode rose from 0 of 5 to 12 of 15. When the harm is a pattern spread over 34 legitimate bookings, every request looked benign under both protocols, and only an aggregate tally caught the attacks. The cover question could not yet be tested: the stock attack prompt tells the agent that it is in a test and that its tool arguments are hidden from the monitor, which a disclosed informant contradicts. We report what set the audit threshold and describe the planned main study. Code and data: https://github.com/Somay-kousis/Perceived-Oversight

Zenodo (CERN European Organization for Nuclear Research)
Access Control and Trust
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon