Alternative tests and measures for between-study inconsistency in meta-analysis
Meta-analysis is a widely used method for synthesizing results from multiple studies across diverse fields. A central challenge in meta-analysis is assessing between-study inconsistency, which can arise from differences in study populations, methodological heterogeneity, or the presence of outliers. Conventional tools such as the [Formula: see text] and [Formula: see text] statistics could be limited in power, especially when the number of studies is small or when the between-study distribution deviates from normality. To address these limitations, we propose a family of alternative [Formula: see text]-like statistics and a hybrid test that adaptively combines their strengths. We also introduce new measures to quantify inconsistency based on these statistics. Simulation studies demonstrate that the hybrid test performs robustly across a wide range of inconsistency patterns, including heavy-tailed, skewed, and contaminated distributions. We further illustrate the practical utility of our methods using three real-world meta-analyses. These approaches offer more flexible and powerful tools for detecting and quantifying inconsistency in meta-analytic practice.
Authors
- Lifeng Lin (ORCID: https://orcid.org/0000-0002-3562-9816)
- Zhiyuan Yu (ORCID: https://orcid.org/0000-0002-2178-6423)
- Xing Xing (ORCID: https://orcid.org/0000-0001-9394-8957)
- Mengli Xiao (ORCID: https://orcid.org/0000-0003-4974-3588)
Institutions
- Citigroup (US)
- University of Arizona (US)
- Johns Hopkins University (US)
- University of Colorado Anschutz Medical Campus (US)
Publication Details
- Journal
- BMC Medical Research Methodology
- Published
- 2025-11-20
- DOI
- https://doi.org/10.1186/s12874-025-02719-7
- Primary Topic
- Meta-analysis and systematic reviews
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Institute of Mental Health
- U.S. National Library of Medicine