On the Validity of Fisher Randomization Tests under the Weak Null
Consider the problem of testing the Neyman weak null of no sample average treatment effect $H_{0N}:τ= 0$ in randomized experiments with binary outcomes. Although the Fisher Randomization Test (FRT) is typically justified under Fisher's sharp null of no individual treatment effect, we show that it is finite-sample-valid for the weak null $H_{0N}$ in three common combinations of study design and test statistic: 1) balanced completely randomized experiments with the difference-in-means test statistic, 2) matched pairs experiments with the same test statistic, and 3) balanced Bernoulli randomized experiments with the centered Horvitz-Thompson test statistic. As an immediate corollary, Fisher's exact test in a balanced completely randomized experiment is valid under the weak null, and so is McNemar's test in a matched pairs experiment. Similar results hold for the one-sided null $H_0:τ\leq 0$. Beyond balanced designs, we show that twice the one-sided FRT $p$-value with the same test statistics is valid under $H_{0N}$. In simulation experiments, the FRTs compare favorably to other exact procedures.
Authors
- Timothy Sudijono (ORCID: https://orcid.org/0000-0002-6075-0378)
- Eric Tchetgen Tchetgen
- Edgar Dobriban (ORCID: https://orcid.org/0000-0002-3467-8931)
Publication Details
- Journal
- arXiv (Cornell University)
- Published
- 2026-11-18
- DOI
- https://doi.org/10.48550/arxiv.2611.24821
- Primary Topic
- Advanced Causal Inference Techniques
- Type
- preprint