The Hidden Cost of Reproducibility: Commercial Software Dependency in Published Research and the Version Accessibility Gap

Abstract The reproducibility crisis in science has prompted widespread efforts to improve data and code sharing. However, a critical yet underexplored barrier persists: dependency on commercial software whose specific versions are often inaccessible for replication. We conducted a cross-sectional empirical study of 10,000 papers published between 2020 and 2025, sampled from PubMed using stratified random sampling across seven research fields. Our analysis reveals that 18.5% of papers relied on commercial software, with an estimated mean replication cost of $1,900 per paper for those requiring proprietary tools. Only 17.0% of detected software had associated version numbers, and the majority of cited commercial software versions were classified as likely unavailable from vendors. Complementing these empirical findings, we conducted a systematic survey of legacy version access policies across major commercial software vendors, finding that no vendor explicitly offers "reproducibility licenses" for verification purposes. We propose a framework for addressing this "version accessibility gap" through the establishment of reproducibility licenses, mandatory version archiving, and enhanced reporting standards. Our complete dataset and analysis pipeline are publicly available to support further research on computational reproducibility.

Authors

Institutions

Publication Details

Journal
EPJ Research Infrastructures
Published
2026-09-01
DOI
https://doi.org/10.1007/s41781-026-00180-9
Primary Topic
Scientific Computing and Data Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Hidden Cost of Reproducibility: Commercial Software Dependency in Published Research and the Version Accessibility Gap

Onishi Tatsuki, Tatsuyoshi Ikenoue
EPJ Research Infrastructures
Scientific Computing and Data Management
article

The Hidden Cost of Reproducibility: Commercial Software Dependency in Published Research and the Version Accessibility Gap

Onishi Tatsuki, Tatsuyoshi Ikenoue
article en

Abstract

Abstract The reproducibility crisis in science has prompted widespread efforts to improve data and code sharing. However, a critical yet underexplored barrier persists: dependency on commercial software whose specific versions are often inaccessible for replication. We conducted a cross-sectional empirical study of 10,000 papers published between 2020 and 2025, sampled from PubMed using stratified random sampling across seven research fields. Our analysis reveals that 18.5% of papers relied on commercial software, with an estimated mean replication cost of $1,900 per paper for those requiring proprietary tools. Only 17.0% of detected software had associated version numbers, and the majority of cited commercial software versions were classified as likely unavailable from vendors. Complementing these empirical findings, we conducted a systematic survey of legacy version access policies across major commercial software vendors, finding that no vendor explicitly offers "reproducibility licenses" for verification purposes. We propose a framework for addressing this "version accessibility gap" through the establishment of reproducibility licenses, mandatory version archiving, and enhanced reporting standards. Our complete dataset and analysis pipeline are publicly available to support further research on computational reproducibility.

EPJ Research InfrastructuresVol. 10(1)
University of Miyazaki (JP), Shiga University (JP)
Partnerships for the goals
Openalex Percentile: Top 60%
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.