DeTAM: Defending LLMs Against Jailbreak Attacks via Targeted Attention Modification

Warning: This paper contains examples of harmful outputs.With the widespread adoption of Large Language Models (LLMs), jailbreak attacks have become an increasingly pressing safety concern.While safety-aligned LLMs can effectively defend against normal harmful queries, they remain vulnerable to such attacks.Existing defense methods primarily rely on finetuning or input modification, which often suffer from limited generalization and reduced utility.To address this, we introduce DETAM, a finetuning-free defense approach that improves the defensive capabilities against jailbreak attacks of LLMs via targeted attention modification.Specifically, we analyze the differences in attention scores between successful and unsuccessful defenses to identify the attention heads sensitive to jailbreak attacks.During inference, we reallocate attention to emphasize users' core intentions, minimizing interference from attack tokens.Our experimental results demonstrate that DETAM outperforms various baselines in jailbreak defense and exhibits robust generalization across different attacks and models, maintaining its effectiveness even on in-thewild jailbreak data.Furthermore, we compare DETAM with the baselines on over-defense datasets, further validating its superior balance between helpfulness and harmlessness.