Mastering a simulation-based parametric method to obtain bias-corrected point estimates and sampling variance for effect sizes

Abstract Meta-analyses require an effect-size estimate and its corresponding sampling variance from primary studies. For some effect size statistics, however, estimators of sampling variance are unavailable, requiring new derivations. Traditionally, such formulas are obtained using hand-derived Taylor expansions (the delta method), but this approach can be technically demanding and inaccessible to many applied researchers. Building on the idea of single-fit parametric resampling, we introduce the SAFE bootstrap: a Single-fit, Accurate, Fast, and Easy simulation recipe that replaces complex algebra with four intuitive steps: fit, draw, transform, and summarise. SAFE is a model-based parametric bootstrap applied to summary statistics, so its performance depends on how well the assumed sampling model approximates the sampling distribution of the reported statistics. Here, we focus on two-group effect sizes that can be parameterised from standard reported summaries, using Gaussian working models for continuous outcomes and binomial or multinomial models for discrete outcomes. Within this framework, SAFE yields model-based, bias-corrected point estimates and standard errors for familiar effect sizes, and readily extends to less common statistics. We first demonstrate SAFE with a simple example, then apply it to common effect sizes, such as the standardised mean difference and the log odds ratio, as well as several less common measures. With additional coding, SAFE can also accommodate zero values and small sample sizes, albeit with important caveats. Our tutorial, accompanied by R code supplements, aims both to clarify the logic of simulation-based estimation from summary statistics and to provide a practical workflow when only summary statistics are available.

Authors

Institutions

Publication Details

Journal
Research Synthesis Methods
Published
2026-09-28
DOI
https://doi.org/10.1017/rsm.2026.10108
Primary Topic
Meta-analysis and systematic reviews
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Mastering a simulation-based parametric method to obtain bias-corrected point estimates and sampling variance for effect sizes

Malgorzata Lagisz, Santiago Ortega, Yefeng Yang, Daniel W. A. Noble et al.
Research Synthesis Methods
Meta-analysis and systematic reviews
article

Mastering a simulation-based parametric method to obtain bias-corrected point estimates and sampling variance for effect sizes

Malgorzata Lagisz, Santiago Ortega, Yefeng Yang, Daniel W. A. Noble, Alistair McNair Senior, Ayumi Mizuno, Coralie Williams, Szymon Marian Drobniak, Shinichi Nakagawa, Erick Lundgren
article en

Abstract

Abstract Meta-analyses require an effect-size estimate and its corresponding sampling variance from primary studies. For some effect size statistics, however, estimators of sampling variance are unavailable, requiring new derivations. Traditionally, such formulas are obtained using hand-derived Taylor expansions (the delta method), but this approach can be technically demanding and inaccessible to many applied researchers. Building on the idea of single-fit parametric resampling, we introduce the SAFE bootstrap: a Single-fit, Accurate, Fast, and Easy simulation recipe that replaces complex algebra with four intuitive steps: fit, draw, transform, and summarise. SAFE is a model-based parametric bootstrap applied to summary statistics, so its performance depends on how well the assumed sampling model approximates the sampling distribution of the reported statistics. Here, we focus on two-group effect sizes that can be parameterised from standard reported summaries, using Gaussian working models for continuous outcomes and binomial or multinomial models for discrete outcomes. Within this framework, SAFE yields model-based, bias-corrected point estimates and standard errors for familiar effect sizes, and readily extends to less common statistics. We first demonstrate SAFE with a simple example, then apply it to common effect sizes, such as the standardised mean difference and the log odds ratio, as well as several less common measures. With additional coding, SAFE can also accommodate zero values and small sample sizes, albeit with important caveats. Our tutorial, accompanied by R code supplements, aims both to clarify the logic of simulation-based estimation from summary statistics and to provide a practical workflow when only summary statistics are available.

Research Synthesis Methods
Australian National University (AU), Jagiellonian University (PL), The University of Sydney (AU), University of Alberta (CA), UNSW Sydney (AU), Zhejiang University (CN)
Openalex Percentile: Top 9%
Meta-analysis and systematic reviews
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.