[Short Paper] Forensic Analysis of Indirect Prompt Injection Attacks on LLM Agents
Large language model (LLM) agents are vulnerable to a range of evolving attacks including Indirect Prompt Injection (IPI). Digital investigations involving IPI attacks on LLM agents are challenging due to growing data volumes and agent flow complexity. We introduce a novel approach for forensic analysis of LLM agent execution logs to identify IPI attacks. We implement a custom digital forensic analysis framework featuring a realistic agentic task benchmark to generate agent logs, for subsequent analysis using 12 state-of-the-art LLMs. Our preliminary results show promising potential for malicious trail detection, with varying performance across domain-specific test suites. We discuss key findings, limitations, and future work directions to support the empirical evaluation of LLMs for digital forensic applications.
Authors
- Maxim Chernyshev (ORCID: https://orcid.org/0000-0002-3302-4530)
- Robin Doss (ORCID: https://orcid.org/0000-0001-6143-6850)
- Zubair Baig (ORCID: https://orcid.org/0000-0002-9245-2703)
Institutions
- Deakin University (AU)
Publication Details
- Published
- 2024-10-28
- DOI
- https://doi.org/10.1109/tps-isa62245.2024.00053
- Citations
- 3
- Primary Topic
- Software System Performance and Reliability
- Type
- article
- Field-Weighted Citation Impact
- 1.05