Beyond Experimental Design: Empirical Reach and the Minimum-Cost Expansion of Scientific Observability

Modern experimental design asks which admissible experiment is most informative, but this question can be ill-posed when the current experimental repertoire itself collapses worlds that matter. We develop Empirical Reach, a framework for detecting this failure and for identifying the minimum-cost admissible expansion of scientific observability. Two possible worlds are empirically equivalent when every experiment constructible from the current repertoire induces the same response law; they are consequentially discordant when a target outcome differs despite that equivalence. We prove a closure-obstruction result: no adaptive policy restricted to the existing experimental closure can distinguish such worlds, regardless of computation, repetition, or decision rule. We then define reliable evidence cost using finite-sample discrimination bounds and show that the cheapest measurement can differ sharply from the cheapest experiment that establishes a consequential distinction. A reproducible software artifact implements empirical partitions, Blackwell controls, information-gain baselines, exact minimum-cost witness search, finite-sample costs, compositional experiment genesis, and continuous probe synthesis. In a controlled benchmark, supplied-model information gain can be maximal while consequential ambiguity remains unchanged; a new interaction with zero information about the supplied model label can eliminate that ambiguity. The contribution is deliberately bounded: finite candidate selection reduces to classical test-cover structure, and probe synthesis is defined relative to an explicit admissible interaction model rather than assumption-free invention. The framework therefore targets a different question from ordinary optimal experimental design: when is science optimizing experiments inside the wrong empirical alphabet?

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-15
DOI
https://doi.org/10.5281/zenodo.22768258
Primary Topic
Scientific Computing and Data Management
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
preprint

Beyond Experimental Design: Empirical Reach and the Minimum-Cost Expansion of Scientific Observability

Md. Amir Khusru Akhtar
Zenodo (CERN European Organization for Nuclear Research)
Scientific Computing and Data Management
preprint

Beyond Experimental Design: Empirical Reach and the Minimum-Cost Expansion of Scientific Observability

Md. Amir Khusru Akhtar
preprint en

Abstract

Modern experimental design asks which admissible experiment is most informative, but this question can be ill-posed when the current experimental repertoire itself collapses worlds that matter. We develop Empirical Reach, a framework for detecting this failure and for identifying the minimum-cost admissible expansion of scientific observability. Two possible worlds are empirically equivalent when every experiment constructible from the current repertoire induces the same response law; they are consequentially discordant when a target outcome differs despite that equivalence. We prove a closure-obstruction result: no adaptive policy restricted to the existing experimental closure can distinguish such worlds, regardless of computation, repetition, or decision rule. We then define reliable evidence cost using finite-sample discrimination bounds and show that the cheapest measurement can differ sharply from the cheapest experiment that establishes a consequential distinction. A reproducible software artifact implements empirical partitions, Blackwell controls, information-gain baselines, exact minimum-cost witness search, finite-sample costs, compositional experiment genesis, and continuous probe synthesis. In a controlled benchmark, supplied-model information gain can be maximal while consequential ambiguity remains unchanged; a new interaction with zero information about the supplied model label can eliminate that ambiguity. The contribution is deliberately bounded: finite candidate selection reduces to classical test-cover structure, and probe synthesis is defined relative to an explicit admissible interaction model rather than assumption-free invention. The framework therefore targets a different question from ordinary optimal experimental design: when is science optimizing experiments inside the wrong empirical alphabet?

Zenodo (CERN European Organization for Nuclear Research)
Reduced inequalities, Peace, Justice and strong institutions
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Beyond Experimental Design: Empirical Reach and the Minimum-Cost Expansion of Scientific Observability — Md. Amir Khusru Akhtar · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS