A Survey of Knowledge Extraction Attacks and Defenses in LLM Agent Ecosystems
Large language model (LLM)-based agents have demonstrated remarkable capabilities in handling complex tasks. However, their development and deployment require substantial human and financial resources, making commercial LLM agents valuable intellectual property (IP) assets and raising concerns about their protection. In particular, knowledge extraction (KE) attacks aim to recover protected knowledge or replicate agent components and functionalities without authorization, posing threats to intellectual property and user privacy. Existing surveys primarily focus on model extraction or address information leakage as part of broader security discussions, leaving knowledge extraction across the LLM-based agent ecosystem insufficiently explored. To bridge this gap, we present a systematic survey of knowledge extraction attacks and defenses in LLM-based agents. We propose an asset-oriented taxonomy that categorizes protected knowledge into three groups: agent training assets, deployment-integrated assets, and runtime reusable assets, encompassing training data, LLMs, prompts, RAG systems, agent memory, and skills. For each category, we systematically examine representative attack mechanisms and corresponding defenses, identifying recent advances and outstanding challenges. This survey aims to provide a comprehensive understanding of knowledge extraction threats and inspire future research toward more secure and trustworthy LLM-based agents.
Authors
- Chen Chen (ORCID: https://orcid.org/0000-0003-3908-6545)
- M. Pan (ORCID: https://orcid.org/0009-0009-8230-7850)
- Xiaoyang Wang (ORCID: https://orcid.org/0000-0003-3554-3219)
- Wenjie Zhang (ORCID: https://orcid.org/0000-0001-6572-2600)
- Ying Zhang (ORCID: https://orcid.org/0000-0002-2674-1638)
- Fan Li (ORCID: https://orcid.org/0009-0004-2951-2226)
- Sijia Xu (ORCID: https://orcid.org/0009-0001-7366-2190)
Publication Details
- Journal
- Preprints.org
- Published
- 2026-10-26
- DOI
- https://doi.org/10.20944/preprints202610.2538.v1
- Primary Topic
- Adversarial Robustness in Machine Learning
- Type
- preprint