[Short Paper] Forensic Analysis of Indirect Prompt Injection Attacks on LLM Agents

Large language model (LLM) agents are vulnerable to a range of evolving attacks including Indirect Prompt Injection (IPI). Digital investigations involving IPI attacks on LLM agents are challenging due to growing data volumes and agent flow complexity. We introduce a novel approach for forensic analysis of LLM agent execution logs to identify IPI attacks. We implement a custom digital forensic analysis framework featuring a realistic agentic task benchmark to generate agent logs, for subsequent analysis using 12 state-of-the-art LLMs. Our preliminary results show promising potential for malicious trail detection, with varying performance across domain-specific test suites. We discuss key findings, limitations, and future work directions to support the empirical evaluation of LLMs for digital forensic applications.

Authors

Institutions

Publication Details

Published
2024-10-28
DOI
https://doi.org/10.1109/tps-isa62245.2024.00053
Citations
3
Primary Topic
Software System Performance and Reliability
Type
article
Field-Weighted Citation Impact
1.05
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

[Short Paper] Forensic Analysis of Indirect Prompt Injection Attacks on LLM Agents

Maxim Chernyshev, Robin Doss, Zubair Baig
3 citations
Software System Performance and Reliability
1.05
article

[Short Paper] Forensic Analysis of Indirect Prompt Injection Attacks on LLM Agents

Maxim Chernyshev, Robin Doss, Zubair Baig
article en
3 citations

Abstract

Large language model (LLM) agents are vulnerable to a range of evolving attacks including Indirect Prompt Injection (IPI). Digital investigations involving IPI attacks on LLM agents are challenging due to growing data volumes and agent flow complexity. We introduce a novel approach for forensic analysis of LLM agent execution logs to identify IPI attacks. We implement a custom digital forensic analysis framework featuring a realistic agentic task benchmark to generate agent logs, for subsequent analysis using 12 state-of-the-art LLMs. Our preliminary results show promising potential for malicious trail detection, with varying performance across domain-specific test suites. We discuss key findings, limitations, and future work directions to support the empirical evaluation of LLMs for digital forensic applications.

Deakin University (AU)
Gender equality
Openalex Percentile: Top 20%
Software System Performance and Reliability
1.05
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

[Short Paper] Forensic Analysis of Indirect Prompt Injection Attacks on LLM Agents — Maxim Chernyshev, Robin Doss, et al. · (2024) | TGRS Research Map | TGRS