Researcher Degrees of Freedom in Psychotherapy Studies: A Systematic Assessment and Comparison of Publications and Registrations of Randomized Controlled Trials of Mindfulness-Based Interventions for Depressive Symptoms

Opportunistic use of flexibility in methodological decisions undermine the credibility of trial findings. Sufficiently specific clinical trial registrations and protocols can help constrain “researcher degrees of freedom” (RDFs). In this preregistered study, we studied the prevalence and quality of registrations and protocols in a stratified random sample of 95 randomized controlled trials of mindfulness-based interventions for depressive symptoms. We assessed strictness, consistency with the corresponding publication, and overall effectiveness in limiting researcher degrees of freedom using a protocol with 27 items across six methodological domains. Thirty-two trials (33.7%) were registered prospectively; 31 (32.6%) retrospectively, and three (3.2%) had unclear timing. Fifteen trials (15.8%) had a publicly available protocol (one prospective). Registrations had mean strictness, consistency, and effectiveness scores of 0.50, 0.42, and 0.36, respectively (on a scale from 0-1), compared with 0.76, 0.69, and 0.60 for protocols. Effectiveness in registrations differed per methodological domain, ranging from 0.62 for the description of interventions to 0.02 for statistical methods. Effectiveness did not differ significantly between prospective and retrospective registrations. Our findings indicate that registrations alone do not fully eliminate the biases caused by RDFs in trials of mindfulness-based interventions. We offer recommendations for improving prospective registration, transparent reporting, and peer review checks to strengthen the credibility of psychotherapy research.

Authors

Publication Details

Journal
PsyArXiv (OSF Preprints)
Published
2026-11-17
DOI
https://doi.org/10.31234/osf.io/2jc5y
Primary Topic
Meta-analysis and systematic reviews
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Researcher Degrees of Freedom in Psychotherapy Studies: A Systematic Assessment and Comparison of Publications and Registrations of Randomized Controlled Trials of Mindfulness-Based Interventions for Depressive Symptoms

Paul Lodder, Cas Goos, Jelte M. Wicherts, Kseniia Nikolaeva et al.
PsyArXiv (OSF Preprints)
Meta-analysis and systematic reviews
preprint

Researcher Degrees of Freedom in Psychotherapy Studies: A Systematic Assessment and Comparison of Publications and Registrations of Randomized Controlled Trials of Mindfulness-Based Interventions for Depressive Symptoms

Paul Lodder, Cas Goos, Jelte M. Wicherts, Kseniia Nikolaeva, Michèle B. Nuijten, Mariam Bolkvadze, Giulia Gasbarro, Xianhua Dennis Peng
preprint en

Abstract

Opportunistic use of flexibility in methodological decisions undermine the credibility of trial findings. Sufficiently specific clinical trial registrations and protocols can help constrain “researcher degrees of freedom” (RDFs). In this preregistered study, we studied the prevalence and quality of registrations and protocols in a stratified random sample of 95 randomized controlled trials of mindfulness-based interventions for depressive symptoms. We assessed strictness, consistency with the corresponding publication, and overall effectiveness in limiting researcher degrees of freedom using a protocol with 27 items across six methodological domains. Thirty-two trials (33.7%) were registered prospectively; 31 (32.6%) retrospectively, and three (3.2%) had unclear timing. Fifteen trials (15.8%) had a publicly available protocol (one prospective). Registrations had mean strictness, consistency, and effectiveness scores of 0.50, 0.42, and 0.36, respectively (on a scale from 0-1), compared with 0.76, 0.69, and 0.60 for protocols. Effectiveness in registrations differed per methodological domain, ranging from 0.62 for the description of interventions to 0.02 for statistical methods. Effectiveness did not differ significantly between prospective and retrospective registrations. Our findings indicate that registrations alone do not fully eliminate the biases caused by RDFs in trials of mindfulness-based interventions. We offer recommendations for improving prospective registration, transparent reporting, and peer review checks to strengthen the credibility of psychotherapy research.

PsyArXiv (OSF Preprints)
Good health and well-being
Meta-analysis and systematic reviews
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon