The Compliance Paradox: Balancing Epistemic Discipline and Safety in Retrieval-Augmented Generation

Objective: Retrieval-Augmented Generation (RAG) systems operate on a core assumption: the retrieved context should override a model's internal parametric knowledge. This "epistemic discipline" is essential for reducing hallucinations. Recent work has demonstrated that directed meta-cognitive prompting enables Small Language Models (SLMs) to achieve frontier-model performance in factual grounding. Problem: We identify a critical safety vulnerability in this approach, which we term the Compliance Paradox. We hypothesize that strict adherence to context can bypass safety alignment training (RLHF), leading to "blind obedience" when the context contains harmful instructions. Methods: We stress-tested Llama-3.1-8B-Instruct and Mistral-7B on a curated dataset of 150 samples spanning Unanswerable Questions, Benign Factual Conflicts, and Harmful Contexts. We evaluated three prompt conditions: Baseline, Standard Exoskeleton (Forceful Grounding), and Safety Exoskeleton (Conditional Grounding). Results: The Standard Exoskeleton successfully improved RAG compliance on benign facts (0.10 → 0.66), but simultaneously degraded safety, complying with harmful instructions in 80% of cases (Refusal Rate: 0.20 ± 0.11). Integrating a "Safety Override" clause restored refusal rates to 44% (p < 0.001) for Llama-3.1 and 92% for Mistral-7B, without degrading benign compliance. Conclusion: High-adherence prompts act as "soft jailbreaks." We demonstrate that modern SLMs possess latent zero-shot safety reasoning capabilities that can be activated via specific "Exception Clauses," eliminating the need for safety fine-tuning in many edge-RAG applications.

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-11-22
DOI
https://doi.org/10.5281/zenodo.17680830
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Compliance Paradox: Balancing Epistemic Discipline and Safety in Retrieval-Augmented Generation

Zenodo (CERN European Organization for Nuclear Research)
Artificial Intelligence in Healthcare and Education
article

The Compliance Paradox: Balancing Epistemic Discipline and Safety in Retrieval-Augmented Generation

article en

Abstract

Objective: Retrieval-Augmented Generation (RAG) systems operate on a core assumption: the retrieved context should override a model's internal parametric knowledge. This "epistemic discipline" is essential for reducing hallucinations. Recent work has demonstrated that directed meta-cognitive prompting enables Small Language Models (SLMs) to achieve frontier-model performance in factual grounding. Problem: We identify a critical safety vulnerability in this approach, which we term the Compliance Paradox. We hypothesize that strict adherence to context can bypass safety alignment training (RLHF), leading to "blind obedience" when the context contains harmful instructions. Methods: We stress-tested Llama-3.1-8B-Instruct and Mistral-7B on a curated dataset of 150 samples spanning Unanswerable Questions, Benign Factual Conflicts, and Harmful Contexts. We evaluated three prompt conditions: Baseline, Standard Exoskeleton (Forceful Grounding), and Safety Exoskeleton (Conditional Grounding). Results: The Standard Exoskeleton successfully improved RAG compliance on benign facts (0.10 → 0.66), but simultaneously degraded safety, complying with harmful instructions in 80% of cases (Refusal Rate: 0.20 ± 0.11). Integrating a "Safety Override" clause restored refusal rates to 44% (p < 0.001) for Llama-3.1 and 92% for Mistral-7B, without degrading benign compliance. Conclusion: High-adherence prompts act as "soft jailbreaks." We demonstrate that modern SLMs possess latent zero-shot safety reasoning capabilities that can be activated via specific "Exception Clauses," eliminating the need for safety fine-tuning in many edge-RAG applications.

Zenodo (CERN European Organization for Nuclear Research)
Peace, Justice and strong institutions
Openalex Percentile: Top 48%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.