SemanticCamo: Jailbreaking Large Language Models through Semantic Camouflage

The rapid development and increasingly widespread applications of Large Language Models (LLMs) have made the safety issues of LLMs more prominent and critical.Although safety training is widely used in LLMs, the mismatch between pre-training and safety training still leads to safety vulnerabilities.To expose the safety vulnerabilities in LLMs and improve LLMs' performance in safety, we propose a novel framework, SemanticCamo, which attacks LLMs through semantic camouflage.Se-manticCamo bypasses safety guardrails by replacing the original unsafe content with semantic features, thereby concealing malicious intent while keeping the query's objectives unchanged.We conduct comprehensive experiments on the state-of-the-art LLMs, including GPT-4o and Claude-3.5,finding that Se-manticCamo successfully induces harmful responses from the target models in over 80% of cases on average, outperforming previous counterparts.Additionally, the performance of SemanticCamo against various defenses is evaluated, demonstrating that semantic transformations introduce critical challenges to LLM safety, necessitating targeted alignment strategies to address this vulnerability.Code and data are available at https://github.com/

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.745
Primary Topic
Digital and Cyber Forensics
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

SemanticCamo: Jailbreaking Large Language Models through Semantic Camouflage

Shi Feng, Jihui Yan, Yifei Zhang, Xiaocui Yang et al.
Digital and Cyber Forensics
article

SemanticCamo: Jailbreaking Large Language Models through Semantic Camouflage

Shi Feng, Jihui Yan, Yifei Zhang, Xiaocui Yang, Daling Wang, Yinzhi Zhao
article en

Abstract

The rapid development and increasingly widespread applications of Large Language Models (LLMs) have made the safety issues of LLMs more prominent and critical.Although safety training is widely used in LLMs, the mismatch between pre-training and safety training still leads to safety vulnerabilities.To expose the safety vulnerabilities in LLMs and improve LLMs' performance in safety, we propose a novel framework, SemanticCamo, which attacks LLMs through semantic camouflage.Se-manticCamo bypasses safety guardrails by replacing the original unsafe content with semantic features, thereby concealing malicious intent while keeping the query's objectives unchanged.We conduct comprehensive experiments on the state-of-the-art LLMs, including GPT-4o and Claude-3.5,finding that Se-manticCamo successfully induces harmful responses from the target models in over 80% of cases on average, outperforming previous counterparts.Additionally, the performance of SemanticCamo against various defenses is evaluated, demonstrating that semantic transformations introduce critical challenges to LLM safety, necessitating targeted alignment strategies to address this vulnerability.Code and data are available at https://github.com/

Northeastern University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 71%
Digital and Cyber Forensics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.