InDe-LLM: Defending against Jailbreak Attacks in LLM-Powered Systems via Intention Disentangling
Jailbreak attacks have been regarded as a crucial threat to LLM-powered software systems. Recent studies indicate the existence of a steering vector within models' internal activations, which can adjust a model's propensity to reject user requests, and thus is regarded as an effective approach for training-free defense. However, attackers may wrap their malicious intentions within a seemingly benign context, which shifts the distribution of harmful prompts toward benign inputs along the steering vector, effectively bypassing existing defense approaches. In this work, we propose a defense framework InDe-LLM based on intention disentangling. By projecting the embedding of inputs into a benign-invariant subspace, we could disentangle the harmful intentions of jailbreak prompts without affecting benign inputs. Next, such disentangled harmful intentions can be easily identified based on LLMs' well-aligned concept of harmfulness, and rejected through activation steering. Our experiments show that InDe-LLM achieves high defense effectiveness, outperforming baselines by 27.2%–43.5% across three models and ten attacks while preserving high utility on benign inputs. Moreover, our evaluation demonstrates that it exhibits high transferability to unseen attacks.
Authors
- Chijin Zhou (ORCID: https://orcid.org/0000-0002-6446-247X)
- Gwihwan Go (ORCID: https://orcid.org/0009-0001-0461-9674)
- Yu Jiang (ORCID: https://orcid.org/0000-0003-0955-503X)
- Quan Zhang (ORCID: https://orcid.org/0000-0001-7778-4243)
- Dalong Shi (ORCID: https://orcid.org/0009-0007-5379-2100)
- Yujue Wang (ORCID: https://orcid.org/0009-0008-3892-9145)
Institutions
- AviChina Industry & Technology (China) (CN)
- East China Normal University (CN)
- Tsinghua University (CN)
Publication Details
- Journal
- Proceedings of the ACM on software engineering.
- Published
- 2026-06-30
- DOI
- https://doi.org/10.1145/3797136
- Primary Topic
- Advanced Malware Detection Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00