Evaluating meta-analysis as a replication success measure

We conclude that when using meta-analysis as a replication success metric, it has a relatively high probability of finding evidence in favour of a non-zero population effect even when it is zero. This behaviour largely results from the significance of the original study. Furthermore, we argue that there are fundamental reasons against using meta-analysis as a metric for replication success.

Authors

Institutions

Publication Details

Journal
PLoS ONE
Published
2024-12-11
DOI
https://doi.org/10.1371/journal.pone.0308495
Citations
1
Primary Topic
Meta-analysis and systematic reviews
Type
article
Field-Weighted Citation Impact
0.46
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluating meta-analysis as a replication success measure

Don van Ravenzwaaij, Henk A. L. Kiers, Jasmine Muradchanian, Rink Hoekstra
1 citations
PLoS ONE
Meta-analysis and systematic reviews
0.46
article

Evaluating meta-analysis as a replication success measure

Don van Ravenzwaaij, Henk A. L. Kiers, Jasmine Muradchanian, Rink Hoekstra
article en
1 citations

Abstract

We conclude that when using meta-analysis as a replication success metric, it has a relatively high probability of finding evidence in favour of a non-zero population effect even when it is zero. This behaviour largely results from the significance of the original study. Furthermore, we argue that there are fundamental reasons against using meta-analysis as a metric for replication success.

PLoS ONEVol. 19(12)
University of Groningen (NL)
Openalex Percentile: Top 26%
Meta-analysis and systematic reviews
0.46
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.