Concordance between clinical trial data use request proposals and corresponding publications: A cross-sectional study

Background/AimsThe reuse of clinical trial data available through data-sharing platforms has grown over the past decade. Several prominent clinical data-sharing platforms require researchers to submit formal research proposals before granting data access, providing an opportunity to evaluate how published analyses compare with initially proposed aims. We evaluated the concordance between the included trials, study objectives, endpoints, and statistical methods specified in researchers' clinical trial data use request proposals to four clinical data-sharing platforms and their corresponding publications.MethodsWe identified all unique data request proposals with at least one corresponding peer-reviewed publication as of 31 March 2023 on four prominent clinical trial data sharing request platforms (Vivli, ClinicalStudyDataRequest.com, the Yale Open Data Access Project, and Supporting Open Access to Researchers-Bristol Myers Squibb). When data requests had multiple publications, we treated each publication-request pair as a unit. For each pair, the trials requested and analyzed were classified as fully concordant, discordant, or unclear, whereas the study objectives, primary and secondary endpoints, and statistical methods were classified as fully concordant, partially concordant, discordant, or unclear. For Vivli, ClinicalStudyDataRequest.com, and Supporting Open Access to Researchers-Bristol Myers Squibb, endpoints of publication-request pairs were not compared because the data request proposals on these platforms do not consistently report this information.ResultsOf 117 Vivli publication-request pairs, 76 (65.0%) were fully concordant for the trials requested and analyzed, 61 (52.1%) for study objectives, and 57 (48.7%) for statistical methods; 35 (29.9%) pairs were fully concordant across the 3 characteristics reported by all platforms. Of 106 ClinicalStudyDataRequest.com publication-request pairs, 66 (62.3%) were fully concordant for the trials requested and analyzed, 41 (38.7%) for study objectives, and 35 (33.0%) for statistical methods; 20 (18.9%) pairs were fully concordant across the 3 characteristics. Of 65 Yale Open Data Access Project publication-request pairs, 35 (53.8%) were fully concordant for the trials requested and analyzed, 44 (67.7%) for primary study objectives, and 25 (38.5%) for statistical methods; 15 (23.1%) pairs were fully concordant across the 3 characteristics. In addition, 26 (40.0%) and 2 (3.1%) Yale Open Data Access Project publication-request pairs were concordant for primary and secondary endpoints, respectively, such that only one (1.5%) Yale Open Data Access Project publication-request pair was fully concordant across all five characteristics reported. Of three Supporting Open Access to Researchers-Bristol Myers Squibb publication-request pairs, one (33.3%) was fully concordant for the trials requested and analyzed, two (66.6%) for primary study objectives, and two (66.6%) for statistical methods; one (33.3%) pair was fully concordant across all three characteristics reported by all platforms.ConclusionAcross four clinical data sharing platforms, data request proposals were often discordant with their corresponding publications, with only 25% concordant across all three key proposal characteristics reported by each platform. Opportunities exist for investigators to describe any data-sharing request proposal deviations in their publications and for platforms to enhance the reporting of key study characteristic specifications.

Authors

Institutions

Publication Details

Journal
Clinical Trials
Published
2024-12-29
DOI
https://doi.org/10.1177/17407745241304355
Primary Topic
Meta-analysis and systematic reviews
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Concordance between clinical trial data use request proposals and corresponding publications: A cross-sectional study

Joseph S. Ross, Joshua D. Wallach, S. P. Bamford, Enrique Vázquez et al.
Clinical Trials
Meta-analysis and systematic reviews
article

Concordance between clinical trial data use request proposals and corresponding publications: A cross-sectional study

Joseph S. Ross, Joshua D. Wallach, S. P. Bamford, Enrique Vázquez, Jessica Ritchie, Karla Childers, Joanne Waldstreicher, Cary P. Gross, Harlan M. Krumholz
article en

Abstract

Background/AimsThe reuse of clinical trial data available through data-sharing platforms has grown over the past decade. Several prominent clinical data-sharing platforms require researchers to submit formal research proposals before granting data access, providing an opportunity to evaluate how published analyses compare with initially proposed aims. We evaluated the concordance between the included trials, study objectives, endpoints, and statistical methods specified in researchers' clinical trial data use request proposals to four clinical data-sharing platforms and their corresponding publications.MethodsWe identified all unique data request proposals with at least one corresponding peer-reviewed publication as of 31 March 2023 on four prominent clinical trial data sharing request platforms (Vivli, ClinicalStudyDataRequest.com, the Yale Open Data Access Project, and Supporting Open Access to Researchers-Bristol Myers Squibb). When data requests had multiple publications, we treated each publication-request pair as a unit. For each pair, the trials requested and analyzed were classified as fully concordant, discordant, or unclear, whereas the study objectives, primary and secondary endpoints, and statistical methods were classified as fully concordant, partially concordant, discordant, or unclear. For Vivli, ClinicalStudyDataRequest.com, and Supporting Open Access to Researchers-Bristol Myers Squibb, endpoints of publication-request pairs were not compared because the data request proposals on these platforms do not consistently report this information.ResultsOf 117 Vivli publication-request pairs, 76 (65.0%) were fully concordant for the trials requested and analyzed, 61 (52.1%) for study objectives, and 57 (48.7%) for statistical methods; 35 (29.9%) pairs were fully concordant across the 3 characteristics reported by all platforms. Of 106 ClinicalStudyDataRequest.com publication-request pairs, 66 (62.3%) were fully concordant for the trials requested and analyzed, 41 (38.7%) for study objectives, and 35 (33.0%) for statistical methods; 20 (18.9%) pairs were fully concordant across the 3 characteristics. Of 65 Yale Open Data Access Project publication-request pairs, 35 (53.8%) were fully concordant for the trials requested and analyzed, 44 (67.7%) for primary study objectives, and 25 (38.5%) for statistical methods; 15 (23.1%) pairs were fully concordant across the 3 characteristics. In addition, 26 (40.0%) and 2 (3.1%) Yale Open Data Access Project publication-request pairs were concordant for primary and secondary endpoints, respectively, such that only one (1.5%) Yale Open Data Access Project publication-request pair was fully concordant across all five characteristics reported. Of three Supporting Open Access to Researchers-Bristol Myers Squibb publication-request pairs, one (33.3%) was fully concordant for the trials requested and analyzed, two (66.6%) for primary study objectives, and two (66.6%) for statistical methods; one (33.3%) pair was fully concordant across all three characteristics reported by all platforms.ConclusionAcross four clinical data sharing platforms, data request proposals were often discordant with their corresponding publications, with only 25% concordant across all three key proposal characteristics reported by each platform. Opportunities exist for investigators to describe any data-sharing request proposal deviations in their publications and for platforms to enhance the reporting of key study characteristic specifications.

Clinical TrialsVol. 22(3)
Yale New Haven Hospital (US), Johnson & Johnson (United States) (US), Emory University (US), Yale Cancer Center (US), Yale University (US), Johnson & Johnson (United Kingdom) (GB)
Bristol-Myers Squibb, Pfizer, Biogen, National Comprehensive Cancer Network, Arnold Ventures, Galápagos, National Institutes of Health, Agency for Healthcare Research and Quality, Genentech, National Institute on Alcohol Abuse and Alcoholism, National Heart, Lung, and Blood Institute, Duke Clinical Research Institute
Openalex Percentile: Top 75%
Meta-analysis and systematic reviews
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.