Improving power by conditioning on less in post-selection inference for changepoints

Abstract Post-selection inference has recently been proposed as a way of quantifying uncertainty about detected changepoints. The idea is to run a changepoint detection algorithm, and then re-use the same data to perform a test for a change near each of the detected changes. By defining the p -value for the test appropriately, so that it is conditional on the information used to choose the test, this approach will produce valid p -values. We show how to improve the power of these procedures by conditioning on less information. This gives rise to an ideal post-selection p -value that is intractable but can be approximated by Monte Carlo. We show that for any Monte Carlo sample size, this procedure produces valid p -values, and empirically that noticeable increase in power is possible with only very modest Monte Carlo sample sizes. Our procedure is easy to implement given existing post-selection inference methods, as we just need to generate perturbations of the data set and re-apply the post-selection method to each of these. On genomic data consisting of human GC content, our procedure increases the number of significant changepoints that are detected when compared to the method of Jewell et al. (J R Stat Soc Ser B 84(4):1082-1104, 2022).

Authors

Institutions

Publication Details

Journal
Statistics and Computing
Published
2024-12-04
DOI
https://doi.org/10.1007/s11222-024-10542-1
Citations
1
Primary Topic
Statistical Methods and Inference
Type
article
Field-Weighted Citation Impact
0.71

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Improving power by conditioning on less in post-selection inference for changepoints

Paul Fearnhead, Rachel Carrington
1 citations
Statistics and Computing
Statistical Methods and Inference
0.71
article

Improving power by conditioning on less in post-selection inference for changepoints

Paul Fearnhead, Rachel Carrington
article en
1 citations

Abstract

Abstract Post-selection inference has recently been proposed as a way of quantifying uncertainty about detected changepoints. The idea is to run a changepoint detection algorithm, and then re-use the same data to perform a test for a change near each of the detected changes. By defining the p -value for the test appropriately, so that it is conditional on the information used to choose the test, this approach will produce valid p -values. We show how to improve the power of these procedures by conditioning on less information. This gives rise to an ideal post-selection p -value that is intractable but can be approximated by Monte Carlo. We show that for any Monte Carlo sample size, this procedure produces valid p -values, and empirically that noticeable increase in power is possible with only very modest Monte Carlo sample sizes. Our procedure is easy to implement given existing post-selection inference methods, as we just need to generate perturbations of the data set and re-apply the post-selection method to each of these. On genomic data consisting of human GC content, our procedure increases the number of significant changepoints that are detected when compared to the method of Jewell et al. (J R Stat Soc Ser B 84(4):1082-1104, 2022).

Statistics and ComputingVol. 35(1)
Lancaster University (GB)
Engineering and Physical Sciences Research Council
Openalex Percentile: Top 24%
Statistical Methods and Inference
0.71
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Improving power by conditioning on less in post-selection inference for changepoints — Paul Fearnhead, Rachel Carrington · Statistics and Computing (2024) | TGRS Research Map | TGRS