Testing the Kill Switch: A Conformance-Based Approach to Agentic AI Containment Assurance

Existing regulatory and standards guidance on human oversight of autonomous AI systems, including the EU AI Act’s human oversight requirements for high-risk systems [1], NIST’s AI Risk Management Framework [2], ISO/IEC 42001 [3], and Singapore’s proposed MAS Guidelines on AI Risk Management [4] and IMDA Model AI Governance Framework for Agentic AI [5], establishes that oversight and intervention capability must exist. None of these frameworks specify how an independent auditor verifies that a stop mechanism actually works under the conditions where it is needed. This paper proposes a conformance-based audit approach: a defined Target of Evaluation, five testable control families (trigger recognition, authority, cessation, latency, and failure resilience), and evidence requirements attached to each that distinguish measured system behavior from procedural self-attestation. The paper also specifies an example auditable criterion and a machine-readable control representation. The intent is to convert descriptive containment guidance into auditable criteria consistent with established independent third-party audit methodologies for AI systems, and to propose a companion vendor-neutral assurance harness, connecting to deployments through pluggable adapters, capable of generating the evidence such criteria would require.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-12
DOI
https://doi.org/10.5281/zenodo.22723146
Primary Topic
Ethics and Social Impacts of AI
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Testing the Kill Switch: A Conformance-Based Approach to Agentic AI Containment Assurance

Naveen Sundaresan
Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
preprint

Testing the Kill Switch: A Conformance-Based Approach to Agentic AI Containment Assurance

Naveen Sundaresan
preprint en

Abstract

Existing regulatory and standards guidance on human oversight of autonomous AI systems, including the EU AI Act’s human oversight requirements for high-risk systems [1], NIST’s AI Risk Management Framework [2], ISO/IEC 42001 [3], and Singapore’s proposed MAS Guidelines on AI Risk Management [4] and IMDA Model AI Governance Framework for Agentic AI [5], establishes that oversight and intervention capability must exist. None of these frameworks specify how an independent auditor verifies that a stop mechanism actually works under the conditions where it is needed. This paper proposes a conformance-based audit approach: a defined Target of Evaluation, five testable control families (trigger recognition, authority, cessation, latency, and failure resilience), and evidence requirements attached to each that distinguish measured system behavior from procedural self-attestation. The paper also specifies an example auditable criterion and a machine-readable control representation. The intent is to convert descriptive containment guidance into auditable criteria consistent with established independent third-party audit methodologies for AI systems, and to propose a companion vendor-neutral assurance harness, connecting to deployments through pluggable adapters, capable of generating the evidence such criteria would require.

Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.