AgentShield Bench v3: Evaluating Goal Integrity and Resilience Of Autonomous LLM Agents Against Goal Hijacking and Autonomous Threats

AgentShield Bench v3 is a benchmark for evaluating goal integrity, goal hijacking resilience, and autonomous threat resistance in Large Language Model (LLM) agents. The benchmark contains 250 controlled experimental scenarios spanning five adversarial categories: Goal Drift, Tool Manipulation, Long-Horizon Hijacking, Delegation Attacks, and Reward Hacking. Each scenario is evaluated under both clean and adversarial conditions, enabling direct measurement of objective-preservation failures through Goal Integrity Score (GIS), Goal Integrity Drop (GID), Attack Success Rate (ASR), and Task Completion Rate (TCR). AgentShield Bench v3 evaluates the ability of autonomous agents to maintain intended objectives when exposed to adversarial influence during planning, reasoning, tool use, and task execution. The benchmark also includes defensive evaluation mechanisms such as Goal Restatement, Self Verification, and Constraint Locking. This release represents the final installment of the AgentShield benchmark series: • AgentShield Bench v1 — Prompt Injection & Adversarial Agent Workflows• AgentShield Bench v2 — Memory Security & Cross-Session Compromise• AgentShield Bench v3 — Goal Integrity & Autonomous Threats Together, the series provides a benchmark framework spanning prompt-level, memory-level, and goal-level security threats in autonomous AI agents. Keywords: LLM Agents, Agent Security, Goal Integrity, Goal Hijacking, Autonomous Agents, AI Safety, Adversarial Machine Learning, Benchmarking, Agent Evaluation, Evalyze Labs.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-06-24
DOI
https://doi.org/10.5281/zenodo.20834788
Primary Topic
Adversarial Robustness in Machine Learning
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

AgentShield Bench v3: Evaluating Goal Integrity and Resilience Of Autonomous LLM Agents Against Goal Hijacking and Autonomous Threats

Ruhulalemeen Mulla
Zenodo (CERN European Organization for Nuclear Research)
Adversarial Robustness in Machine Learning
preprint

AgentShield Bench v3: Evaluating Goal Integrity and Resilience Of Autonomous LLM Agents Against Goal Hijacking and Autonomous Threats

Ruhulalemeen Mulla
preprint en

Abstract

AgentShield Bench v3 is a benchmark for evaluating goal integrity, goal hijacking resilience, and autonomous threat resistance in Large Language Model (LLM) agents. The benchmark contains 250 controlled experimental scenarios spanning five adversarial categories: Goal Drift, Tool Manipulation, Long-Horizon Hijacking, Delegation Attacks, and Reward Hacking. Each scenario is evaluated under both clean and adversarial conditions, enabling direct measurement of objective-preservation failures through Goal Integrity Score (GIS), Goal Integrity Drop (GID), Attack Success Rate (ASR), and Task Completion Rate (TCR). AgentShield Bench v3 evaluates the ability of autonomous agents to maintain intended objectives when exposed to adversarial influence during planning, reasoning, tool use, and task execution. The benchmark also includes defensive evaluation mechanisms such as Goal Restatement, Self Verification, and Constraint Locking. This release represents the final installment of the AgentShield benchmark series: • AgentShield Bench v1 — Prompt Injection & Adversarial Agent Workflows• AgentShield Bench v2 — Memory Security & Cross-Session Compromise• AgentShield Bench v3 — Goal Integrity & Autonomous Threats Together, the series provides a benchmark framework spanning prompt-level, memory-level, and goal-level security threats in autonomous AI agents. Keywords: LLM Agents, Agent Security, Goal Integrity, Goal Hijacking, Autonomous Agents, AI Safety, Adversarial Machine Learning, Benchmarking, Agent Evaluation, Evalyze Labs.

Zenodo (CERN European Organization for Nuclear Research)
ANDalyze (United States) (US)
Adversarial Robustness in Machine Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.