A large-scale in silico replication of ecological and evolutionary studies

Despite the growing concerns about the replicability of ecological and evolutionary studies, no results exist from a field-wide replication project. We conduct a large-scale in silico replication project, leveraging cutting-edge statistical methodologies. Replicability is 30%-40% for studies with marginal statistical significance in the absence of selective reporting, whereas the replicability of studies presenting 'strong' evidence against the null hypothesis H<sub>0</sub> is >70%. The former requires a sevenfold larger sample size to reach the latter's replicability. We call for a change in planning, conducting and publishing research towards a transparent, credible and replicable ecology and evolution.

Authors

Institutions

Publication Details

Journal
Nature Ecology & Evolution
Published
2024-09-26
DOI
https://doi.org/10.1038/s41559-024-02530-5
Citations
7
Primary Topic
Evolution and Genetic Dynamics
Type
article
Field-Weighted Citation Impact
3.85

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A large-scale in silico replication of ecological and evolutionary studies

Yefeng Yang, Erik W. van Zwet, Shinichi Nakagawa, Nikolaos Ignatiadis
7 citations
Nature Ecology & Evolution
Evolution and Genetic Dynamics
3.85
article

A large-scale in silico replication of ecological and evolutionary studies

Yefeng Yang, Erik W. van Zwet, Shinichi Nakagawa, Nikolaos Ignatiadis
article en
7 citations

Abstract

Despite the growing concerns about the replicability of ecological and evolutionary studies, no results exist from a field-wide replication project. We conduct a large-scale in silico replication project, leveraging cutting-edge statistical methodologies. Replicability is 30%-40% for studies with marginal statistical significance in the absence of selective reporting, whereas the replicability of studies presenting 'strong' evidence against the null hypothesis H<sub>0</sub> is >70%. The former requires a sevenfold larger sample size to reach the latter's replicability. We call for a change in planning, conducting and publishing research towards a transparent, credible and replicable ecology and evolution.

Nature Ecology & EvolutionVol. 8(12)
University of Alberta (CA), Leiden University Medical Center (NL), UNSW Sydney (AU), University of Chicago (US), Environmental Earth Sciences (AU)
University of New South Wales, National Natural Science Foundation of China, Australian Research Council
Life in Land
Openalex Percentile: Top 6%
Evolution and Genetic Dynamics
3.85
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.