Clinical trials for digital health interventions: a rapid review of study independence and the developer effect

Digital health interventions (DHIs) using apps, web-based platforms, or other digital tools are increasingly deployed to support prevention, health promotion, and disease management. Unlike mandates and reporting guidelines established for traditional pharmaceutical trials, it remains unclear to what extent DHI trials vary in the degree of developer involvement in trial conduct or sponsorship, and whether such involvement should raise concerns about risk of bias in estimated trial effectiveness. This review aimed to narratively map and summarize published systematic reviews of randomized controlled trials (RCTs) evaluating DHIs, with a focus on quantifying developer involvement and its association with the significance of reported trial outcomes. Systematic reviews published between 2013 and 2025 were identified from four databases, targeting interventions in nutrition, maternal health, mental health, and sleep. Data were extracted on trial characteristics, developer involvement, preregistration, participant population, DHI cost and public availability, and outcome significance. Across 229 trials from 29 systematic reviews, 73% of trials were conducted with direct developer involvement, whereas 27% were independent. Developer-involved trials were more likely to be preregistered than independent trials (OR = 2.47, p = 0.004). When weighted by sample size, developer-involved trials had higher odds of reporting statistically significant results than independent trials within each category (OR = 1.23, 95% CI 1.16–1.31, p < 0.001). This review highlights the prevalence of developer involvement in DHI trials and its potential influence on reported outcomes, underscoring the need for greater transparency in publications, independent efficacy trials, and regulatory oversight for digital health technologies. Future research should examine how varying forms of developer engagement affect trial design, reporting, and effect sizes, to ensure credible, safe, and effective evidence generation in digital health.

Authors

Institutions

Publication Details

Journal
npj Digital Medicine
Published
2026-09-17
DOI
https://doi.org/10.1038/s41746-026-03234-9
Primary Topic
Mobile Health and mHealth Applications
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Clinical trials for digital health interventions: a rapid review of study independence and the developer effect

Sajeev Kohli, Henning Tiemeier, Hui Zhou
npj Digital Medicine
Mobile Health and mHealth Applications
article

Clinical trials for digital health interventions: a rapid review of study independence and the developer effect

Sajeev Kohli, Henning Tiemeier, Hui Zhou
article en

Abstract

Digital health interventions (DHIs) using apps, web-based platforms, or other digital tools are increasingly deployed to support prevention, health promotion, and disease management. Unlike mandates and reporting guidelines established for traditional pharmaceutical trials, it remains unclear to what extent DHI trials vary in the degree of developer involvement in trial conduct or sponsorship, and whether such involvement should raise concerns about risk of bias in estimated trial effectiveness. This review aimed to narratively map and summarize published systematic reviews of randomized controlled trials (RCTs) evaluating DHIs, with a focus on quantifying developer involvement and its association with the significance of reported trial outcomes. Systematic reviews published between 2013 and 2025 were identified from four databases, targeting interventions in nutrition, maternal health, mental health, and sleep. Data were extracted on trial characteristics, developer involvement, preregistration, participant population, DHI cost and public availability, and outcome significance. Across 229 trials from 29 systematic reviews, 73% of trials were conducted with direct developer involvement, whereas 27% were independent. Developer-involved trials were more likely to be preregistered than independent trials (OR = 2.47, p = 0.004). When weighted by sample size, developer-involved trials had higher odds of reporting statistically significant results than independent trials within each category (OR = 1.23, 95% CI 1.16–1.31, p < 0.001). This review highlights the prevalence of developer involvement in DHI trials and its potential influence on reported outcomes, underscoring the need for greater transparency in publications, independent efficacy trials, and regulatory oversight for digital health technologies. Future research should examine how varying forms of developer engagement affect trial design, reporting, and effect sizes, to ensure credible, safe, and effective evidence generation in digital health.

npj Digital Medicine
Harvard University (US), Harvard College Observatory (US), Harvard Global Health Institute (US), University of Pennsylvania (US)
U.S. Department of Health and Human Services, Health Resources and Services Administration
Openalex Percentile: Top 7%
Mobile Health and mHealth Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.