Paper I: A Funder-Driven Registered Report Initiative Compared with Standard Applications: A Study on Research Quality

Background and aim: A registered report (RR) commits researchers to a peer-reviewed protocol before results are known, reducing reporting bias and promoting open science. Foundation Dam, a health research funder, launched a two-year initiative incentivising RR applications. This study describes projects choosing RR versus standard applications (SA) and assesses differences in reviewer scores.Method: The sample comprises all research grant applicants at Foundation Dam, 2023 to 2025 (N=1194). Using a multilevel linear regression model, we compared Excellence and Implementation scores between RR and SA applications across the 2023 research call (SA n=358) with those from the 2024/2025 calls (RR n=142, SA n=694). Intraclass correlation coefficients assessed reviewer-related variance, and exploratory analyses examined reviewers' confidence and disagreement levels. Preregistered Stage 1 protocol: https://osf.io/jq84x/overview (date of in-principle acceptance: 20/01/2026).Results: RR applications were not scored significantly higher than SA applications on Excellence (β= −0.08, 95% CI [−0.20, 0.03], p=.131) or Implementation (β= −0.04, 95% CI [−0.14, 0.06], p=.408). Excellence scores were slightly lower in the 2024/2025 calls than in the 2023 call (β= −0.08, 95% CI [−0.16, 0.00], p=.048), whereas Implementation scores did not change. Reviewer variability accounted for 18.3% of the variance in Excellence scores and 15.4% in Implementation scores, and was not greater for RR than SA applications. Conclusion: Findings do not support that choosing RR format yields higher assessed research quality at the application stage, but are informative for funders and journals developing their own RR models.

Authors

Publication Details

Journal
MetArXiv (OSF Preprints)
Published
2026-11-06
DOI
https://doi.org/10.31222/osf.io/s9fy5_v1
Primary Topic
Academic Publishing and Open Access
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Paper I: A Funder-Driven Registered Report Initiative Compared with Standard Applications: A Study on Research Quality

Ida C. Svege, Sigrid Hegna Ingvaldsen, Jan-Ole Hesselberg
1 links
MetArXiv (OSF Preprints)
Academic Publishing and Open Access
preprint

Paper I: A Funder-Driven Registered Report Initiative Compared with Standard Applications: A Study on Research Quality

Ida C. Svege, Sigrid Hegna Ingvaldsen, Jan-Ole Hesselberg
preprint en

Abstract

Background and aim: A registered report (RR) commits researchers to a peer-reviewed protocol before results are known, reducing reporting bias and promoting open science. Foundation Dam, a health research funder, launched a two-year initiative incentivising RR applications. This study describes projects choosing RR versus standard applications (SA) and assesses differences in reviewer scores.Method: The sample comprises all research grant applicants at Foundation Dam, 2023 to 2025 (N=1194). Using a multilevel linear regression model, we compared Excellence and Implementation scores between RR and SA applications across the 2023 research call (SA n=358) with those from the 2024/2025 calls (RR n=142, SA n=694). Intraclass correlation coefficients assessed reviewer-related variance, and exploratory analyses examined reviewers' confidence and disagreement levels. Preregistered Stage 1 protocol: https://osf.io/jq84x/overview (date of in-principle acceptance: 20/01/2026).Results: RR applications were not scored significantly higher than SA applications on Excellence (β= −0.08, 95% CI [−0.20, 0.03], p=.131) or Implementation (β= −0.04, 95% CI [−0.14, 0.06], p=.408). Excellence scores were slightly lower in the 2024/2025 calls than in the 2023 call (β= −0.08, 95% CI [−0.16, 0.00], p=.048), whereas Implementation scores did not change. Reviewer variability accounted for 18.3% of the variance in Excellence scores and 15.4% in Implementation scores, and was not greater for RR than SA applications. Conclusion: Findings do not support that choosing RR format yields higher assessed research quality at the application stage, but are informative for funders and journals developing their own RR models.

MetArXiv (OSF Preprints)
Academic Publishing and Open Access
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon