Permutation tests for detecting treatment effect heterogeneity in cluster randomized trials

Cluster randomized trials are widely used in healthcare research for the evaluation of intervention strategies. Beyond estimating the average treatment effect, it is often of interest to assess whether the treatment effect varies across subgroups. While conventional methods based on tests of interaction terms between treatment and covariates can be used to detect treatment effect heterogeneity in cluster randomized trials, they typically rely on parametric assumptions that may not hold in practice. Adapting existing permutation tests from individually randomized trials, however, requires conceptual clarification and modification due to the multiple possible interpretations of treatment effect heterogeneity in the cluster randomized trial context. In this work, we develop variations of permutation tests and clarify key causal definitions in order to assess treatment effect heterogeneity in cluster randomized trials. Our procedure enables investigators to simultaneously test for effect modification across a large number of covariates, while maintaining nominal type I error rates and reasonable power in simulation studies. In the Pain Program for Active Coping and Training (PPACT) study, the proposed methods are able to detect treatment effect heterogeneity that was not identified by conventional methods assessing treatment-covariate interactions.

Authors

Institutions

Publication Details

Journal
Statistical Methods in Medical Research
Published
2025-06-17
DOI
https://doi.org/10.1177/09622802251348999
Primary Topic
Advanced Causal Inference Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Permutation tests for detecting treatment effect heterogeneity in cluster randomized trials

Sebastien Haneuse, Lara Maleyeff, Fan Li, Rui Wang
Statistical Methods in Medical Research
Advanced Causal Inference Techniques
article

Permutation tests for detecting treatment effect heterogeneity in cluster randomized trials

Sebastien Haneuse, Lara Maleyeff, Fan Li, Rui Wang
article en

Abstract

Cluster randomized trials are widely used in healthcare research for the evaluation of intervention strategies. Beyond estimating the average treatment effect, it is often of interest to assess whether the treatment effect varies across subgroups. While conventional methods based on tests of interaction terms between treatment and covariates can be used to detect treatment effect heterogeneity in cluster randomized trials, they typically rely on parametric assumptions that may not hold in practice. Adapting existing permutation tests from individually randomized trials, however, requires conceptual clarification and modification due to the multiple possible interpretations of treatment effect heterogeneity in the cluster randomized trial context. In this work, we develop variations of permutation tests and clarify key causal definitions in order to assess treatment effect heterogeneity in cluster randomized trials. Our procedure enables investigators to simultaneously test for effect modification across a large number of covariates, while maintaining nominal type I error rates and reasonable power in simulation studies. In the Pain Program for Active Coping and Training (PPACT) study, the proposed methods are able to detect treatment effect heterogeneity that was not identified by conventional methods assessing treatment-covariate interactions.

Statistical Methods in Medical ResearchVol. 34(8)
Harvard University (US), Yale University (US), Harvard Pilgrim Health Care (US), McGill University (CA)
Patient-Centered Outcomes Research Institute, National Institute of Allergy and Infectious Diseases
Good health and well-being
Openalex Percentile: Top 86%
Advanced Causal Inference Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Permutation tests for detecting treatment effect heterogeneity in cluster randomized trials — Sebastien Haneuse, Lara Maleyeff, et al. · Statistical Methods in Medical Research (2025) | TGRS Research Map | TGRS