Radical reproducibility, real constraints: An autoethnography of open and transparent research from the inside

BACKGROUND: This paper presents a three-year longitudinal autoethnographic study of the TIER2 project, an international, interdisciplinary consortium committed to "radical reproducibility" through open research practices. We investigated how epistemic diversity, disciplinary norms, and institutional cultures shape reproducibility in practice. METHODS/MATERIALS: We take an auto-ethnographic approach. Data include periodic consortium-wide surveys, quarterly reproducibility diaries by five diarists, and fieldnotes from General Assembly discussions; these were coded inductively. RESULTS: We found that initial disciplinary differences in defining reproducibility evolved to a nuanced appreciation of its complexity. Participants developed new competencies in open research practices and experienced insights regarding early planning and collaborative transparency. Enablers of reproducibility include the Open Science Framework, co-developed tools, containerization, and "slow science" approaches, strong role modeling by senior researchers and improved documentation. Challenges include fear of exposing imperfect work, unequal engagement across career stages, and substantial time and resource demands. Epistemic tensions emerged around the applicability of reproducibility to qualitative research and the risk of standardization undermining diversity. Despite these, participants reported high professional satisfaction and intellectual growth. CONCLUSION: The study demonstrates that "radical reproducibility" is not merely a technical but a cultural and epistemic project that fosters collective learning, skill development and innovation, and requires systemic and institutional support.

Authors

Institutions

Publication Details

Journal
Accountability in Research
Published
2026-08-24
DOI
https://doi.org/10.1080/08989621.2026.2721689
Primary Topic
Research Data Management Practices
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Radical reproducibility, real constraints: An autoethnography of open and transparent research from the inside

Serge P. J. M. Horbach, Nicki Lisa Cole
Accountability in Research
Research Data Management Practices
article

Radical reproducibility, real constraints: An autoethnography of open and transparent research from the inside

Serge P. J. M. Horbach, Nicki Lisa Cole
article en

Abstract

BACKGROUND: This paper presents a three-year longitudinal autoethnographic study of the TIER2 project, an international, interdisciplinary consortium committed to "radical reproducibility" through open research practices. We investigated how epistemic diversity, disciplinary norms, and institutional cultures shape reproducibility in practice. METHODS/MATERIALS: We take an auto-ethnographic approach. Data include periodic consortium-wide surveys, quarterly reproducibility diaries by five diarists, and fieldnotes from General Assembly discussions; these were coded inductively. RESULTS: We found that initial disciplinary differences in defining reproducibility evolved to a nuanced appreciation of its complexity. Participants developed new competencies in open research practices and experienced insights regarding early planning and collaborative transparency. Enablers of reproducibility include the Open Science Framework, co-developed tools, containerization, and "slow science" approaches, strong role modeling by senior researchers and improved documentation. Challenges include fear of exposing imperfect work, unequal engagement across career stages, and substantial time and resource demands. Epistemic tensions emerged around the applicability of reproducibility to qualitative research and the risk of standardization undermining diversity. Despite these, participants reported high professional satisfaction and intellectual growth. CONCLUSION: The study demonstrates that "radical reproducibility" is not merely a technical but a cultural and epistemic project that fosters collective learning, skill development and innovation, and requires systemic and institutional support.

Accountability in Research
Radboud University Nijmegen (NL), Know Center Research GmbH (Austria) (AT)
Openalex Percentile: Top 43%
Research Data Management Practices
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.