Powerful partial conjunction hypothesis testing via conditioning

Summary A partial conjunction hypothesis test combines information across a set of base hypotheses to determine whether some subset is nonnull. Partial conjunction hypothesis tests arise in a diverse array of fields, but standard partial conjunction hypothesis testing methods can be highly conservative, leading to low power especially in low-signal settings commonly encountered in applications. In this paper, we introduce the conditional partial conjunction hypothesis test, a new method for testing a single partial conjunction hypothesis that directly corrects the conservativeness of standard approaches by conditioning on certain order statistics of the base $ p $-values. Under distributional assumptions commonly encountered in partial conjunction hypothesis testing, the proposed test is valid and produces nearly uniformly distributed $ p $-values under the null, i.e., the $ p $-values are only very slightly conservative. We demonstrate that our proposed test matches or outperforms existing single partial conjunction hypothesis tests with particular power gains in low-signal settings, maintains Type-I error control even under model misspecification and can be used to outperform state-of-the-art multiple partial conjunction hypothesis testing procedures in certain settings, particularly when side information is present. Finally, we illustrate an application of our proposed test through a replicability analysis across DNA microarray studies.

Authors

Institutions

Publication Details

Journal
Biometrika
Published
2025-01-01
DOI
https://doi.org/10.1093/biomet/asaf036
Primary Topic
Fault Detection and Control Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Powerful partial conjunction hypothesis testing via conditioning

Lucas Janson, Biyonka Liang, Li Zhang
Biometrika
Fault Detection and Control Systems
article

Powerful partial conjunction hypothesis testing via conditioning

Lucas Janson, Biyonka Liang, Li Zhang
article en

Abstract

Summary A partial conjunction hypothesis test combines information across a set of base hypotheses to determine whether some subset is nonnull. Partial conjunction hypothesis tests arise in a diverse array of fields, but standard partial conjunction hypothesis testing methods can be highly conservative, leading to low power especially in low-signal settings commonly encountered in applications. In this paper, we introduce the conditional partial conjunction hypothesis test, a new method for testing a single partial conjunction hypothesis that directly corrects the conservativeness of standard approaches by conditioning on certain order statistics of the base $ p $-values. Under distributional assumptions commonly encountered in partial conjunction hypothesis testing, the proposed test is valid and produces nearly uniformly distributed $ p $-values under the null, i.e., the $ p $-values are only very slightly conservative. We demonstrate that our proposed test matches or outperforms existing single partial conjunction hypothesis tests with particular power gains in low-signal settings, maintains Type-I error control even under model misspecification and can be used to outperform state-of-the-art multiple partial conjunction hypothesis testing procedures in certain settings, particularly when side information is present. Finally, we illustrate an application of our proposed test through a replicability analysis across DNA microarray studies.

BiometrikaVol. 112(4)
Harvard University (US), Harvard University Press (US)
Openalex Percentile: Top 88%
Fault Detection and Control Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.