SECURITY AND PRIVACY CHALLENGES IN AGENTIC AI SYSTEMS

Agentic Artificial Intelligence (AI) systems can plan multi-step tasks, use external tools, retrieve information, andtake actions with limited human intervention. These capabilities create security and privacy risks beyond those found inconventional question-answering systems. An agent may encounter malicious instructions in retrieved content, misuse anauthorized tool, expose confidential context, retain unnecessary personal data, or continue a harmful action through a chain ofotherwise ordinary steps. This paper presents a risk-aware framework for analysing these challenges across the agent lifecycle. Itorganizes the main risks into instruction and prompt injection, excessive agency, insecure tool integration, data leakage, identityand access-control weaknesses, memory risks, and insufficient monitoring. The proposed approach combines least-privilegepermissions, separation of trusted instructions from untrusted data, explicit approval for high-impact actions, privacy-awarememory, output validation, and audit logging. A staged evaluation plan is described using threat scenarios and measurablesecurity and privacy indicators. This paper is a design-oriented study and does not claim experimental results or a deployedsecurity product. Its central argument is that agentic AI should be treated as a socio-technical system whose safety depends on themodel, tools, data, permissions, and surrounding operational controls

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-19
DOI
https://doi.org/10.5281/zenodo.23484436
Primary Topic
Adversarial Robustness in Machine Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

SECURITY AND PRIVACY CHALLENGES IN AGENTIC AI SYSTEMS

Pratiksha Gardade
Zenodo (CERN European Organization for Nuclear Research)
Adversarial Robustness in Machine Learning
article

SECURITY AND PRIVACY CHALLENGES IN AGENTIC AI SYSTEMS

Pratiksha Gardade
article en

Abstract

Agentic Artificial Intelligence (AI) systems can plan multi-step tasks, use external tools, retrieve information, andtake actions with limited human intervention. These capabilities create security and privacy risks beyond those found inconventional question-answering systems. An agent may encounter malicious instructions in retrieved content, misuse anauthorized tool, expose confidential context, retain unnecessary personal data, or continue a harmful action through a chain ofotherwise ordinary steps. This paper presents a risk-aware framework for analysing these challenges across the agent lifecycle. Itorganizes the main risks into instruction and prompt injection, excessive agency, insecure tool integration, data leakage, identityand access-control weaknesses, memory risks, and insufficient monitoring. The proposed approach combines least-privilegepermissions, separation of trusted instructions from untrusted data, explicit approval for high-impact actions, privacy-awarememory, output validation, and audit logging. A staged evaluation plan is described using threat scenarios and measurablesecurity and privacy indicators. This paper is a design-oriented study and does not claim experimental results or a deployedsecurity product. Its central argument is that agentic AI should be treated as a socio-technical system whose safety depends on themodel, tools, data, permissions, and surrounding operational controls

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 13%
Adversarial Robustness in Machine Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.