Bayes factor hypothesis testing in meta-analyses: Practical advantages and methodological considerations

Abstract Bayesian hypothesis testing via Bayes factors offers a principled alternative to classical p -value methods in meta-analysis, particularly suited to its cumulative and sequential nature. Unlike p -values, Bayes factors allow for quantifying support both for and against the existence of an effect, facilitate ongoing evidence monitoring, and maintain coherent long-run behavior as additional studies are incorporated. Recent theoretical developments further show how Bayes factors can flexibly control Type I error rates through connections to e-value theory. Despite these advantages, their use remains limited in the meta-analytic literature. This article provides a critical overview of their theoretical properties, methodological considerations—such as prior sensitivity—and practical advantages for evidence synthesis. Two illustrative applications are provided: one on statistical learning in individuals with language impairments, and another on seroma incidence following post-operative exercise in breast cancer patients. New tools supporting these methods are available in the open-source R package BFpack.

Authors

Institutions

Publication Details

Journal
Research Synthesis Methods
Published
2025-12-04
DOI
https://doi.org/10.1017/rsm.2025.10060
Citations
1
Primary Topic
Meta-analysis and systematic reviews
Type
article
Field-Weighted Citation Impact
1.40
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Bayes factor hypothesis testing in meta-analyses: Practical advantages and methodological considerations

Robbie C. M. van Aert, Joris Mulder
1 citations
Research Synthesis Methods
Meta-analysis and systematic reviews
1.40
article

Bayes factor hypothesis testing in meta-analyses: Practical advantages and methodological considerations

Robbie C. M. van Aert, Joris Mulder
article en
1 citations

Abstract

Abstract Bayesian hypothesis testing via Bayes factors offers a principled alternative to classical p -value methods in meta-analysis, particularly suited to its cumulative and sequential nature. Unlike p -values, Bayes factors allow for quantifying support both for and against the existence of an effect, facilitate ongoing evidence monitoring, and maintain coherent long-run behavior as additional studies are incorporated. Recent theoretical developments further show how Bayes factors can flexibly control Type I error rates through connections to e-value theory. Despite these advantages, their use remains limited in the meta-analytic literature. This article provides a critical overview of their theoretical properties, methodological considerations—such as prior sensitivity—and practical advantages for evidence synthesis. Two illustrative applications are provided: one on statistical learning in individuals with language impairments, and another on seroma incidence following post-operative exercise in breast cancer patients. New tools supporting these methods are available in the open-source R package BFpack.

Research Synthesis Methods
Tilburg University (NL)
Openalex Percentile: Top 11%
Meta-analysis and systematic reviews
1.40
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.