Quantization-Based Jailbreaking Vulnerability Analysis: A Study on Performance and Safety of the Llama3-8B-Instruct Model

This study systematically investigates how quantization affects the safety of large language models (LLMs), with a particular focus on jailbreaking vulnerabilities in multilingual and tense-shifted scenarios. Using Llama3-8B-Instruct as a representative open-source model, we evaluate 23 quantization levels across two languages (English/Korean) and three tenses (present/past/future). Our results reveal a non-linear relationship between quantization and safety: 4-bit quantization emerges as a practical "sweet spot," maintaining near-baseline performance while significantly reducing computational costs. However, substantial vulnerabilities persist—Korean prompts exhibit attack success rates 25.5 percentage points higher than their English counterparts, and past-tense transformations increase vulnerability by 39.3 percentage points. These findings highlight that current LLM safety mechanisms are often biased toward English and present-tense prompts, underscoring the need for new evaluation frameworks that account for linguistic and temporal diversity in quantized LLM deployment. Although this study has limitations, including its reliance on a single model, a single dataset, and automated evaluation method, it provides the first quantitative analysis of quantization-induced vulnerabilities in multilingual and tense-varied contexts.

Authors

Institutions

Publication Details

Journal
IEEE Access
Published
2025-01-01
DOI
https://doi.org/10.1109/access.2025.3594287
Citations
1
Primary Topic
Marine and Coastal Research
Type
article
Field-Weighted Citation Impact
1.15
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Quantization-Based Jailbreaking Vulnerability Analysis: A Study on Performance and Safety of the Llama3-8B-Instruct Model

Jaesik Lee
1 citations
IEEE Access
Marine and Coastal Research
1.15
article

Quantization-Based Jailbreaking Vulnerability Analysis: A Study on Performance and Safety of the Llama3-8B-Instruct Model

Jaesik Lee
article en
1 citations

Abstract

This study systematically investigates how quantization affects the safety of large language models (LLMs), with a particular focus on jailbreaking vulnerabilities in multilingual and tense-shifted scenarios. Using Llama3-8B-Instruct as a representative open-source model, we evaluate 23 quantization levels across two languages (English/Korean) and three tenses (present/past/future). Our results reveal a non-linear relationship between quantization and safety: 4-bit quantization emerges as a practical "sweet spot," maintaining near-baseline performance while significantly reducing computational costs. However, substantial vulnerabilities persist—Korean prompts exhibit attack success rates 25.5 percentage points higher than their English counterparts, and past-tense transformations increase vulnerability by 39.3 percentage points. These findings highlight that current LLM safety mechanisms are often biased toward English and present-tense prompts, underscoring the need for new evaluation frameworks that account for linguistic and temporal diversity in quantized LLM deployment. Although this study has limitations, including its reliance on a single model, a single dataset, and automated evaluation method, it provides the first quantitative analysis of quantization-induced vulnerabilities in multilingual and tense-varied contexts.

IEEE AccessVol. 13
National Information Society Agency (KR)
Peace, Justice and strong institutions
Openalex Percentile: Top 21%
Marine and Coastal Research
1.15
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Quantization-Based Jailbreaking Vulnerability Analysis: A Study on Performance and Safety of the Llama3-8B-Instruct Model — Jaesik Lee · IEEE Access (2025) | TGRS Research Map | TGRS