‘Replication games’ test the robustness of social-science studies

A large-scale assessment of the reproducibility and robustness of 110 articles published in leading economics and political-science journals finds that more than 85% were computationally reproducible, and 72% of statistically significant results remained significant and in the same direction in robustness checks. About 25% of the evaluated articles contained non‑trivial coding errors. Work to replicate studies in economics and political science highlights the importance of sharing data and code.

Publication Details

Journal
Nature
Published
2026-04-01
DOI
https://doi.org/10.1038/d41586-026-00684-9
Primary Topic
Scientific Computing and Data Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

‘Replication games’ test the robustness of social-science studies

Nature
Scientific Computing and Data Management
article

‘Replication games’ test the robustness of social-science studies

article en

Abstract

A large-scale assessment of the reproducibility and robustness of 110 articles published in leading economics and political-science journals finds that more than 85% were computationally reproducible, and 72% of statistically significant results remained significant and in the same direction in robustness checks. About 25% of the evaluated articles contained non‑trivial coding errors. Work to replicate studies in economics and political science highlights the importance of sharing data and code.

Nature
Gender equality
Openalex Percentile: Top 5%
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.