Does Chain-of-Thought Reasoning Really Reduce Harmfulness from Jailbreaking?
Jailbreak attacks have been observed to largely fail against recent reasoning models enhanced by Chain-of-Thought (CoT) reasoning.However, the underlying mechanism remains underexplored, and relying solely on reasoning capacity may raise security concerns.In this paper, we try to answer the question: Does CoT reasoning really reduce harmfulness from jailbreaking?Through rigorous theoretical analysis, we demonstrate that CoT reasoning has dual effects on jailbreaking harmfulness.Based on the theoretical insights, we propose a novel jailbreak method, FICDETAIL, whose practical performance validates our theoretical findings.Warning: This work contains potentially offensive LLM-generated content.* Equal contribution. 1 q p (P )f (P )h (i) (P ) dP J Key factors affecting harmfulness with CoT.Proposition 1 implies that the expected harmfulness is influenced by several crucial factors:
Authors
- Yu Huang (ORCID: https://orcid.org/0000-0002-9935-7717)
- Xiaoyu Fan (ORCID: https://orcid.org/0000-0002-0390-5871)
- Chengda Lu (ORCID: https://orcid.org/0000-0002-9452-4053)
- Jijie Li
- Rongwu Xu
- Wei Xu
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.findings-acl.339
- Primary Topic
- Deception detection and forensic psychology
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China