Bayesian Evaluation of Replication Studies

In this paper a method is proposed to determine whether the result from an original study is corroborated in a replication study. The paper is illustrated using two replication studies and the corresponding original studies from the Reproducibility Project: Psychology by the Open Science Collaboration. This method emphasizes the need to determine what one wants to replicate from the original paper. This can be done by translating the research hypotheses formulated in the introduction into informative hypotheses, or, by translating the results into interval hypotheses. The Bayes factor will be used to determine whether the hypotheses resulting from the original study are corroborated by the replication study. Our method to assess the successfulness of replication will better fit the needs and desires of researchers in fields that use replication studies.

Authors

Institutions

Publication Details

Journal
Meta-Psychology
Published
2024-12-20
DOI
https://doi.org/10.15626/mp.2020.2554
Primary Topic
Advanced Causal Inference Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Bayesian Evaluation of Replication Studies

Charlotte Rietbergen, Hidde Jelmer Leplaa, Herbert Hoijtink
1 links
Meta-Psychology
Advanced Causal Inference Techniques
article

Bayesian Evaluation of Replication Studies

Charlotte Rietbergen, Hidde Jelmer Leplaa, Herbert Hoijtink
article en

Abstract

In this paper a method is proposed to determine whether the result from an original study is corroborated in a replication study. The paper is illustrated using two replication studies and the corresponding original studies from the Reproducibility Project: Psychology by the Open Science Collaboration. This method emphasizes the need to determine what one wants to replicate from the original paper. This can be done by translating the research hypotheses formulated in the introduction into informative hypotheses, or, by translating the results into interval hypotheses. The Bayes factor will be used to determine whether the hypotheses resulting from the original study are corroborated by the replication study. Our method to assess the successfulness of replication will better fit the needs and desires of researchers in fields that use replication studies.

Meta-PsychologyVol. 8
Utrecht University (NL)
Openalex Percentile: Top 74%
Advanced Causal Inference Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Bayesian Evaluation of Replication Studies — Charlotte Rietbergen, Hidde Jelmer Leplaa, et al. · Meta-Psychology (2024) | TGRS Research Map | TGRS