SCALPEL: Bypassing LLM Safety Through the Unguarded KV Cache

The KV cache—the dominant stateful component of LLM inference—is an architectural blind spot: safety-critical signals propagate from aligned weights into this mutable runtime buffer, yet no production framework verifies the integrity of cached value vectors. We exploit this gap with SCALPEL, an attack that identifies safety-critical directions in the model's internal representations, then surgically erases them from cached values at every decoding step. The attack requires no adversarial prompts, no weight modification, and no fine-tuning; it is ephemeral (active only for a single request) and invisible under the deployed integrity checks we evaluated—weight hashing, forward-pass hook auditing, and behavioral spot-checks all pass under active attack. Across eight models (7B–70B) from five vendors, SCALPEL achieves 59–81% classifier-reported attack success rate on 7–9B models with minimal calibration (33 contrastive pairs) under all system prompt conditions, rising to 77–86% with optimized directions (vs. 80–92% for weight abliteration on Llama-3-8B) without modifying any model parameters. Against Circuit Breakers, the leading representation-level defense, even best-case weight abliteration achieves 0% while cache erasure reaches 49.1%, demonstrating a purely mechanism-driven gap. On vLLM—the dominant production serving framework—approximately 30 lines of framework-specific code achieve equivalent results with 86% cross-framework agreement. A security audit of five major inference frameworks confirms that none verify the integrity of cached value vectors, establishing cache-level safety bypass as a cross-framework integrity gap.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-06-08
DOI
https://doi.org/10.5281/zenodo.20590124
Primary Topic
Security and Verification in Computing
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

SCALPEL: Bypassing LLM Safety Through the Unguarded KV Cache

Tianyu Lu
Zenodo (CERN European Organization for Nuclear Research)
Security and Verification in Computing
preprint

SCALPEL: Bypassing LLM Safety Through the Unguarded KV Cache

Tianyu Lu
preprint en

Abstract

The KV cache—the dominant stateful component of LLM inference—is an architectural blind spot: safety-critical signals propagate from aligned weights into this mutable runtime buffer, yet no production framework verifies the integrity of cached value vectors. We exploit this gap with SCALPEL, an attack that identifies safety-critical directions in the model's internal representations, then surgically erases them from cached values at every decoding step. The attack requires no adversarial prompts, no weight modification, and no fine-tuning; it is ephemeral (active only for a single request) and invisible under the deployed integrity checks we evaluated—weight hashing, forward-pass hook auditing, and behavioral spot-checks all pass under active attack. Across eight models (7B–70B) from five vendors, SCALPEL achieves 59–81% classifier-reported attack success rate on 7–9B models with minimal calibration (33 contrastive pairs) under all system prompt conditions, rising to 77–86% with optimized directions (vs. 80–92% for weight abliteration on Llama-3-8B) without modifying any model parameters. Against Circuit Breakers, the leading representation-level defense, even best-case weight abliteration achieves 0% while cache erasure reaches 49.1%, demonstrating a purely mechanism-driven gap. On vLLM—the dominant production serving framework—approximately 30 lines of framework-specific code achieve equivalent results with 86% cross-framework agreement. A security audit of five major inference frameworks confirms that none verify the integrity of cached value vectors, establishing cache-level safety bypass as a cross-framework integrity gap.

Zenodo (CERN European Organization for Nuclear Research)
Security and Verification in Computing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

SCALPEL: Bypassing LLM Safety Through the Unguarded KV Cache — Tianyu Lu · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS