The Digital Experiment Reporting Protocol (DERP)

Transparent reporting is a cornerstone of credible and reproducible research, yet digital experiments—randomized studies conducted in online or computerized environments—often lack clear reporting standards. To address this gap, we adapt and extend the CONSORT Statement, a widely used checklist for clinical trials, to develop a reporting checklist tailored for digital experiments. While the checklist is broadly applicable across disciplines, we demonstrate its relevance through an empirical application to digital experiments published in two leading Information Systems (IS) journals: Information Systems Research and MIS Quarterly. Our analysis reveals substantial shortcomings in reporting quality, with only 43% of the papers providing sufficient detail on core items. These findings highlight the urgent need for standardized reporting in digital experimentation. The proposed checklist offers a practical tool for authors, reviewers, and editors to enhance the transparency, rigor, and replicability of digital experiments.

Authors

Publication Details

Journal
Communications of the Association for Information Systems
Published
2025-01-01
DOI
https://doi.org/10.17705/1cais.05706
Primary Topic
Scientific Computing and Data Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Digital Experiment Reporting Protocol (DERP)

Joseph S. Valacich, Christoph Schneider, Markus Weinmann
Communications of the Association for Information Systems
Scientific Computing and Data Management
article

The Digital Experiment Reporting Protocol (DERP)

Joseph S. Valacich, Christoph Schneider, Markus Weinmann
article en

Abstract

Transparent reporting is a cornerstone of credible and reproducible research, yet digital experiments—randomized studies conducted in online or computerized environments—often lack clear reporting standards. To address this gap, we adapt and extend the CONSORT Statement, a widely used checklist for clinical trials, to develop a reporting checklist tailored for digital experiments. While the checklist is broadly applicable across disciplines, we demonstrate its relevance through an empirical application to digital experiments published in two leading Information Systems (IS) journals: Information Systems Research and MIS Quarterly. Our analysis reveals substantial shortcomings in reporting quality, with only 43% of the papers providing sufficient detail on core items. These findings highlight the urgent need for standardized reporting in digital experimentation. The proposed checklist offers a practical tool for authors, reviewers, and editors to enhance the transparency, rigor, and replicability of digital experiments.

Communications of the Association for Information SystemsVol. 57(1)
Openalex Percentile: Top 81%
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

The Digital Experiment Reporting Protocol (DERP) — Joseph S. Valacich, Christoph Schneider, et al. · Communications of the Association for Information Systems (2025) | TGRS Research Map | TGRS