The Removability Gap: An Empirical Evaluation of Taint-Closure Verification, Its Soundness Boundary, and Adversary-Resistant Fusion in Retrieval-Augmented Generation

A companion formalization paper named the Removability Gap — the structural distance between not using a deleted datum and not being influenced by it — and proposed taint-closure removability and adversary-resistant multi-source confidence to close and audit it. This paper reports the empirical validation, end-to-end, on retrieval-augmented generation over a frozen base model (Qwen3-8B and BGE-M3, exact-NN retrieval), with all artifacts sealed in a tamper-evident manifest chain. We report three results and their boundaries without smoothing. First, the gap is real but conditionally witnessed: an information-equivalent paraphrase evades a set-membership deletion check on 200/200 targets and, where it survives retrieval, recovers the deleted fact perfectly (effect size > 2); but the same low lexical overlap that defeats set-membership suppresses retrieval against surviving sibling facts, so population-level witnessing depends on store density (admissible attack rate 17% / 35% / 52.5% as siblings drop 7 / 3 / 1). Second, taint-closure closes the gap in the exact regime: on the same 200 paraphrases, set-membership detects 0, retrieval-dependent detection 34, and taint-closure 200, at zero false-positive rate, with a soundness theorem — while honestly missing an independently-authored equivalent it has no lineage edge to. Third, fusion covers both attack types (detection 1.0 each) — but at a cost the original gate battery did not measure: at the shipped operating point that coverage carries a ≈57% honest false-positive rate (0.569, 95% CI [0.516, 0.622] across seeds), because the honest and adversarial fused-score distributions overlap and the threshold that catches every attack also flags most legitimate deletions. Its worst-case robustness is likewise asymmetric and stated, not blanket: each attack type has exactly one critical channel, so the fused verifier has two disclosed single points of failure. The contribution is a characterized result: the gap exists and is closable by provenance where lineage is recorded, the realizability of the attack is bounded and quantified, and the limits of the defense are mapped rather than hidden.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-07-02
DOI
https://doi.org/10.5281/zenodo.21132734
Primary Topic
Advanced Malware Detection Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Removability Gap: An Empirical Evaluation of Taint-Closure Verification, Its Soundness Boundary, and Adversary-Resistant Fusion in Retrieval-Augmented Generation

Andre Byrd
Zenodo (CERN European Organization for Nuclear Research)
Advanced Malware Detection Techniques
article

The Removability Gap: An Empirical Evaluation of Taint-Closure Verification, Its Soundness Boundary, and Adversary-Resistant Fusion in Retrieval-Augmented Generation

Andre Byrd
article en

Abstract

A companion formalization paper named the Removability Gap — the structural distance between not using a deleted datum and not being influenced by it — and proposed taint-closure removability and adversary-resistant multi-source confidence to close and audit it. This paper reports the empirical validation, end-to-end, on retrieval-augmented generation over a frozen base model (Qwen3-8B and BGE-M3, exact-NN retrieval), with all artifacts sealed in a tamper-evident manifest chain. We report three results and their boundaries without smoothing. First, the gap is real but conditionally witnessed: an information-equivalent paraphrase evades a set-membership deletion check on 200/200 targets and, where it survives retrieval, recovers the deleted fact perfectly (effect size > 2); but the same low lexical overlap that defeats set-membership suppresses retrieval against surviving sibling facts, so population-level witnessing depends on store density (admissible attack rate 17% / 35% / 52.5% as siblings drop 7 / 3 / 1). Second, taint-closure closes the gap in the exact regime: on the same 200 paraphrases, set-membership detects 0, retrieval-dependent detection 34, and taint-closure 200, at zero false-positive rate, with a soundness theorem — while honestly missing an independently-authored equivalent it has no lineage edge to. Third, fusion covers both attack types (detection 1.0 each) — but at a cost the original gate battery did not measure: at the shipped operating point that coverage carries a ≈57% honest false-positive rate (0.569, 95% CI [0.516, 0.622] across seeds), because the honest and adversarial fused-score distributions overlap and the threshold that catches every attack also flags most legitimate deletions. Its worst-case robustness is likewise asymmetric and stated, not blanket: each attack type has exactly one critical channel, so the fused verifier has two disclosed single points of failure. The contribution is a characterized result: the gap exists and is closable by provenance where lineage is recorded, the realizability of the attack is bounded and quantified, and the limits of the defense are mapped rather than hidden.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 5%
Advanced Malware Detection Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

The Removability Gap: An Empirical Evaluation of Taint-Closure Verification, Its Soundness Boundary, and Adversary-Resistant Fusion in Retrieval-Augmented Generation — Andre Byrd · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS