Prompt injection and Data Exfiltration Attacks in Large Language Model Applications: Detection and Mitigation Framework

Large Language Models (LLMs) such as GPT-4, Gemini, Claude, and open-source transformer systems are rapidly being embedded into real-world applications including chatbots, enterprise knowledge assistants, healthcare systems, and developer tools. While these models offer unprecedented capabilities in natural language reasoning, they introduce a new class of security vulnerabilities known as prompt injection and data exfiltration attacks. Unlike traditional software exploits that target code or network layers, these attacks manipulate the instruction-following behavior of LLMs through carefully crafted textual inputs. Recent studies demonstrate that malicious prompts can override system rules, expose hidden prompts, and retrieve sensitive data from connected tools and documents. This paper presents an in-depth study of prompt injection mechanisms, analyzes data leakage paths in LLM-powered systems, and proposes a structured detection and mitigation framework for secure LLM deployment. Experimental simulations validate the effectiveness of the framework in reducing adversarial success rates. The findings emphasize the need for AI-aware security practices in modern software architectures.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-04-28
DOI
https://doi.org/10.5281/zenodo.19843089
Primary Topic
Adversarial Robustness in Machine Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Prompt injection and Data Exfiltration Attacks in Large Language Model Applications: Detection and Mitigation Framework

Lahari B A
Zenodo (CERN European Organization for Nuclear Research)
Adversarial Robustness in Machine Learning
article

Prompt injection and Data Exfiltration Attacks in Large Language Model Applications: Detection and Mitigation Framework

Lahari B A
article en

Abstract

Large Language Models (LLMs) such as GPT-4, Gemini, Claude, and open-source transformer systems are rapidly being embedded into real-world applications including chatbots, enterprise knowledge assistants, healthcare systems, and developer tools. While these models offer unprecedented capabilities in natural language reasoning, they introduce a new class of security vulnerabilities known as prompt injection and data exfiltration attacks. Unlike traditional software exploits that target code or network layers, these attacks manipulate the instruction-following behavior of LLMs through carefully crafted textual inputs. Recent studies demonstrate that malicious prompts can override system rules, expose hidden prompts, and retrieve sensitive data from connected tools and documents. This paper presents an in-depth study of prompt injection mechanisms, analyzes data leakage paths in LLM-powered systems, and proposes a structured detection and mitigation framework for secure LLM deployment. Experimental simulations validate the effectiveness of the framework in reducing adversarial success rates. The findings emphasize the need for AI-aware security practices in modern software architectures.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 4%
Adversarial Robustness in Machine Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.