DISARM: Taint-gated counterfactual auditing for efficient defense against indirect prompt injection

The integration of external tools and untrusted data has transformed large language models (LLMs) into autonomous agents, but also exposes them to indirect prompt injection (IPI) attacks, where adversarial instructions in external content can manipulate tool use and compromise system behavior. Existing defenses use input filtering, reasoning correction, or execution control, but often trade attack suppression against task utility or runtime cost. We propose DISARM , a training-free defense that mediates action commitment at the tool boundary between agent-internal planning and external tool execution. DISARM keeps ordinary steps on a lightweight fast path and invokes one additional planner run only for selected checkpoints after removing any detected suspicious spans. It compares the proposed and replayed actions by tool path and critical arguments, allowing consistent actions, using the replayed action when only critical arguments differ within an unchanged tool path, and blocking tool-path deviations. This selective single-replay policy jointly targets security, utility, and low latency. On AgentDojo with GPT-4o, DISARM reduces the four-attack average attack success rate (ASR) from 23.01% to 0.37% while increasing utility under attack (UA) from 63.69% to 73.63%. On benign tasks, its 4.29s latency is 9.44% above No Defense but 56.22% and 66.80% below MELON-Aug and IPIGUARD, respectively. Across five LLM backends, the largest observed suite-level average ASR is 1.56%. Complementary WASP and all-suite fixed-configuration adaptive evaluations further examine transfer and gate coverage: no successful attacker objective is observed in the evaluated Base64 and fragmentation cases, whereas semantic parameter pollution retains 1.11% ASR. These results support DISARM as a lightweight tool-boundary defense while exposing the boundary of cue-based gating.

Authors

Institutions

Publication Details

Journal
Journal of Computer Security
Published
2026-11-04
DOI
https://doi.org/10.1177/0926227x261505043
Primary Topic
Adversarial Robustness in Machine Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

DISARM: Taint-gated counterfactual auditing for efficient defense against indirect prompt injection

Guanhang Shi, Lei Shi, Jin Li, Ping Chen et al.
Journal of Computer Security
Adversarial Robustness in Machine Learning
article

DISARM: Taint-gated counterfactual auditing for efficient defense against indirect prompt injection

Guanhang Shi, Lei Shi, Jin Li, Ping Chen, Yu Liu, Xuemei Luo, Jiangxing Wu, Yuewantong Song, Yiran Chen, Jin Wei, Kai Wang
article en

Abstract

The integration of external tools and untrusted data has transformed large language models (LLMs) into autonomous agents, but also exposes them to indirect prompt injection (IPI) attacks, where adversarial instructions in external content can manipulate tool use and compromise system behavior. Existing defenses use input filtering, reasoning correction, or execution control, but often trade attack suppression against task utility or runtime cost. We propose DISARM , a training-free defense that mediates action commitment at the tool boundary between agent-internal planning and external tool execution. DISARM keeps ordinary steps on a lightweight fast path and invokes one additional planner run only for selected checkpoints after removing any detected suspicious spans. It compares the proposed and replayed actions by tool path and critical arguments, allowing consistent actions, using the replayed action when only critical arguments differ within an unchanged tool path, and blocking tool-path deviations. This selective single-replay policy jointly targets security, utility, and low latency. On AgentDojo with GPT-4o, DISARM reduces the four-attack average attack success rate (ASR) from 23.01% to 0.37% while increasing utility under attack (UA) from 63.69% to 73.63%. On benign tasks, its 4.29s latency is 9.44% above No Defense but 56.22% and 66.80% below MELON-Aug and IPIGUARD, respectively. Across five LLM backends, the largest observed suite-level average ASR is 1.56%. Complementary WASP and all-suite fixed-configuration adaptive evaluations further examine transfer and gate coverage: no successful attacker objective is observed in the evaluated Base64 and fragmentation cases, whereas semantic parameter pollution retains 1.11% ASR. These results support DISARM as a lightweight tool-boundary defense while exposing the boundary of cue-based gating.

Journal of Computer Security
Fudan University (CN), Zhengzhou University (CN)
Openalex Percentile: Top 16%
Adversarial Robustness in Machine Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon