Formal Security of Tool-Using AI Agents in Enterprise and Organizational Systems

Tool-using artificial-intelligence agents are rapidly moving from conversational assistants to autonomous actors that can read organizational data, invoke APIs, modify production systems, send messages, create financial transactions, administer identities, trigger industrial workflows, and delegate tasks to other agents. This transition creates a structural security problem: a probabilistic and potentially compromised planner may be granted deterministic authority over high-impact systems. Existing work has made substantial progress on prompt-injection resistance, information-flow control, capability tracking, MCP access control, least privilege, agent governance, and safety benchmarking. Yet the security problem remains fragmented across authorization, data flow, delegation, temporal constraints, human approval, and action-sequence composition. This paper proposes the Formal Agent Authority and Control Kernel (FAACK), a domain-independent model that treats the AI agent as untrusted and places a deterministic reference monitor outside the model. The kernel mediates every effectful action and combines unforgeable capabilities, contextual authorization, lattice-based information-flow control, delegation attenuation, trace-level safety predicates, and scoped human approvals. We formalize agents, tools, resources, actions, labels, capabilities, delegation chains, approvals, system states, and execution traces. Under explicit trust assumptions, we prove five properties: authorization safety, delegation non-escalation, trace-safety preservation, approval soundness for critical actions, and termination-insensitive noninterference for labeled outputs under conservative context tainting. The results show that useful safety guarantees need not depend on proving the language model itself safe: the planner may be probabilistic, manipulated, or Byzantine, while the externally observable effects remain constrained by a deterministic enforcement boundary. We position the model against the literature available through September 2026 and propose a multi-domain evaluation protocol spanning finance, human resources, DevOps, executive assistance, cybersecurity, data platforms, and industrial operations. The central design principle is simple: the agent may propose; only the security kernel may authorize. This shifts agent security from model trust to verifiable authority control.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-12
DOI
https://doi.org/10.5281/zenodo.22720875
Primary Topic
Access Control and Trust
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Formal Security of Tool-Using AI Agents in Enterprise and Organizational Systems

Mouctar Diallo
Zenodo (CERN European Organization for Nuclear Research)
Access Control and Trust
article

Formal Security of Tool-Using AI Agents in Enterprise and Organizational Systems

Mouctar Diallo
article en

Abstract

Tool-using artificial-intelligence agents are rapidly moving from conversational assistants to autonomous actors that can read organizational data, invoke APIs, modify production systems, send messages, create financial transactions, administer identities, trigger industrial workflows, and delegate tasks to other agents. This transition creates a structural security problem: a probabilistic and potentially compromised planner may be granted deterministic authority over high-impact systems. Existing work has made substantial progress on prompt-injection resistance, information-flow control, capability tracking, MCP access control, least privilege, agent governance, and safety benchmarking. Yet the security problem remains fragmented across authorization, data flow, delegation, temporal constraints, human approval, and action-sequence composition. This paper proposes the Formal Agent Authority and Control Kernel (FAACK), a domain-independent model that treats the AI agent as untrusted and places a deterministic reference monitor outside the model. The kernel mediates every effectful action and combines unforgeable capabilities, contextual authorization, lattice-based information-flow control, delegation attenuation, trace-level safety predicates, and scoped human approvals. We formalize agents, tools, resources, actions, labels, capabilities, delegation chains, approvals, system states, and execution traces. Under explicit trust assumptions, we prove five properties: authorization safety, delegation non-escalation, trace-safety preservation, approval soundness for critical actions, and termination-insensitive noninterference for labeled outputs under conservative context tainting. The results show that useful safety guarantees need not depend on proving the language model itself safe: the planner may be probabilistic, manipulated, or Byzantine, while the externally observable effects remain constrained by a deterministic enforcement boundary. We position the model against the literature available through September 2026 and propose a multi-domain evaluation protocol spanning finance, human resources, DevOps, executive assistance, cybersecurity, data platforms, and industrial operations. The central design principle is simple: the agent may propose; only the security kernel may authorize. This shifts agent security from model trust to verifiable authority control.

Zenodo (CERN European Organization for Nuclear Research)
Peace, Justice and strong institutions
Openalex Percentile: Top 4%
Access Control and Trust
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.