The Independence Pricing Error in AI Safety: How Correlated Failures Invalidate Defence in Depth

Modern AI safety architectures rely on defence in depth: multiple safety layers—RLHF, constitutional AI, red teaming, output filtering, monitoring—are stacked under the assumption that each catches failures the others miss. If the layers fail independently with probability p, then n layers reduce residual risk to p^n. We show this assumption is structurally false. Safety layers share training distributions, cultural priors about harm, and optimisation targets, producing a dependence parameter d > 1 such that the true residual risk is d^n · p^n—exponentially worse than the independence estimate. We define the independence pricing error R(n) = P_obs(n) / P_ind(n), the ratio of observed co-failure frequency to the frequency predicted under independence, and show that R(n) ≈ d^n for homogeneous layers. We identify seven domains where the independence assumption is load-bearing in current AI governance: multi-model ensembles, safety-layer stacking, evaluation benchmarks, foundation-model concentration, oversight committees, red-team coverage, and deployment-risk assessment. For each, we derive the form of d, estimate its magnitude from public data on transferable jailbreaks, shared hallucination patterns, and benchmark correlation, and propose a measurement protocol. We find that plausible values of d range from 1.5 to 8, implying that four "independent" safety layers provide between 5× and 4,096× less protection than their operators believe. We propose a dependence-adjusted safety framework: a real-time R oracle for AI systems, mandatory dependence disclosure in safety cases, and minimum-independence requirements for regulatory compliance. The framework converts the qualitative intuition that "AI failures are correlated" into a quantitative metric that governance bodies can measure, audit, and enforce.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-01
DOI
https://doi.org/10.5281/zenodo.23874337
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Independence Pricing Error in AI Safety: How Correlated Failures Invalidate Defence in Depth

Tal Zisckind
Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
article

The Independence Pricing Error in AI Safety: How Correlated Failures Invalidate Defence in Depth

Tal Zisckind
article en

Abstract

Modern AI safety architectures rely on defence in depth: multiple safety layers—RLHF, constitutional AI, red teaming, output filtering, monitoring—are stacked under the assumption that each catches failures the others miss. If the layers fail independently with probability p, then n layers reduce residual risk to p^n. We show this assumption is structurally false. Safety layers share training distributions, cultural priors about harm, and optimisation targets, producing a dependence parameter d > 1 such that the true residual risk is d^n · p^n—exponentially worse than the independence estimate. We define the independence pricing error R(n) = P_obs(n) / P_ind(n), the ratio of observed co-failure frequency to the frequency predicted under independence, and show that R(n) ≈ d^n for homogeneous layers. We identify seven domains where the independence assumption is load-bearing in current AI governance: multi-model ensembles, safety-layer stacking, evaluation benchmarks, foundation-model concentration, oversight committees, red-team coverage, and deployment-risk assessment. For each, we derive the form of d, estimate its magnitude from public data on transferable jailbreaks, shared hallucination patterns, and benchmark correlation, and propose a measurement protocol. We find that plausible values of d range from 1.5 to 8, implying that four "independent" safety layers provide between 5× and 4,096× less protection than their operators believe. We propose a dependence-adjusted safety framework: a real-time R oracle for AI systems, mandatory dependence disclosure in safety cases, and minimum-independence requirements for regulatory compliance. The framework converts the qualitative intuition that "AI failures are correlated" into a quantitative metric that governance bodies can measure, audit, and enforce.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 8%
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon