From review to synthesis: A step-by-step methodological guide to systematic reviews and multilevel meta-analyses
We provide a step-by-step guide on conducting a quantitative systematic review (i.e., meta-analysis) using the open-source programming language R, as well as conducting a multilevel meta-analysis, in contexts where effect sizes are non-independent (e.g., multiple studies from the same lab). Quantitative systematic reviews offer researchers a method for synthesizing large bodies of literature, helping clarify inconsistent findings, identify research gaps, and refine theoretical models. However, existing tutorials often assume prior knowledge and/or experience, often overlooking foundational concepts. To address this gap, a comprehensive walkthrough of the systematic review process is presented, covering pre-registration, literature search and retrieval, screening, risk of bias assessment, and data extraction following the PRISMA framework. We then present detailed guidance on how to conduct both traditional and multilevel meta-analyses in R. Specifically, the tutorial explains how to estimate overall meta-analytic effect sizes when effect sizes are independent (traditional meta-analysis) and when effect sizes are nested within labs (multilevel meta-analysis). Procedures for assessing heterogeneity, testing for publication bias, and conducting moderation analyses are also covered. To accompany this tutorial, we supplement annotated R scripts and R notebooks to support transparency, reproducibility, and accessibility for researchers of all levels of experience.
Authors
- Nadyanna M. Majeed (ORCID: https://orcid.org/0000-0003-0148-0846)
- Xun Ci Soh
- Meilan Hu (ORCID: https://orcid.org/0009-0002-0806-9355)
- Paye Shin Koh
- Andree Hartanto
Institutions
- National University of Singapore (SG)
- Singapore Management University (SG)
Publication Details
- Journal
- Behavior Research Methods
- Published
- 2026-06-16
- DOI
- https://doi.org/10.3758/s13428-026-02961-x
- Primary Topic
- Meta-analysis and systematic reviews
- Type
- article
- Field-Weighted Citation Impact
- 0.00