Large Language Models Across the Clinical Trial Lifecycle: A Scoping Review of Applications, Methodologies, and Validation Gaps

Abstract Large language models (LLMs) are increasingly being incorporated into clinical trial research, yet evidence of their utility is fragmented across isolated tasks, trial stages, model architectures, and evaluation strategies. This fragmentation makes it difficult to determine where LLMs provide meaningful value, where evidence remains preliminary, and what barriers limit their translation into routine clinical research. We therefore systematically characterized generative LLM applications across the clinical trial lifecycle, defined here as the interconnected stages of trial design, participant recruitment, trial conduct, and data analysis. We reviewed 71 studies published between January 2023 and August 2025 and examined their applications, technical approaches, and validation strategies. LLM applications were concentrated in Analysis (40.8%) and Recruitment (31.0%), followed by Design (18.3%) and Conduct (5.6%). Among all studies, 34 (47.9%) reported better performance than traditional machine-learning or previous language-model comparators, whereas 32 (45.1%) did not include such comparisons. Human-based evaluation was reported in 25 studies (35.2%), but prospective and operational validation remained limited. By mapping applications and evidentiary maturity across the full clinical trial lifecycle, this review identifies a substantial gap between rapidly expanding technical capabilities and evidence supporting real-world implementation. These findings provide a structured evidence base for prioritizing rigorous validation, transparent governance, and clinically meaningful evaluation as LLMs transition from experimental tools toward operational components of clinical research.

Authors

Institutions

Publication Details

Journal
Research Square
Published
2026-11-09
DOI
https://doi.org/10.21203/rs.3.rs-11343754/v1
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Large Language Models Across the Clinical Trial Lifecycle: A Scoping Review of Applications, Methodologies, and Validation Gaps

Halil Kilicoglu B, Huixue Zhou, Xiangming Zhan, Y. Chen et al.
Research Square
Artificial Intelligence in Healthcare and Education
preprint

Large Language Models Across the Clinical Trial Lifecycle: A Scoping Review of Applications, Methodologies, and Validation Gaps

Halil Kilicoglu B, Huixue Zhou, Xiangming Zhan, Y. Chen, Shufan Ming, Xiaoyi Chen, Han Yang, Zaifu Zhan, Yongkang Xiao, Yifan Wu, Xinyu Zhou, Kai Yu, Shuang Zhou, Yuan Luo, Yu Hou, Rui Zhang, Meijia Song
preprint en

Abstract

Abstract Large language models (LLMs) are increasingly being incorporated into clinical trial research, yet evidence of their utility is fragmented across isolated tasks, trial stages, model architectures, and evaluation strategies. This fragmentation makes it difficult to determine where LLMs provide meaningful value, where evidence remains preliminary, and what barriers limit their translation into routine clinical research. We therefore systematically characterized generative LLM applications across the clinical trial lifecycle, defined here as the interconnected stages of trial design, participant recruitment, trial conduct, and data analysis. We reviewed 71 studies published between January 2023 and August 2025 and examined their applications, technical approaches, and validation strategies. LLM applications were concentrated in Analysis (40.8%) and Recruitment (31.0%), followed by Design (18.3%) and Conduct (5.6%). Among all studies, 34 (47.9%) reported better performance than traditional machine-learning or previous language-model comparators, whereas 32 (45.1%) did not include such comparisons. Human-based evaluation was reported in 25 studies (35.2%), but prospective and operational validation remained limited. By mapping applications and evidentiary maturity across the full clinical trial lifecycle, this review identifies a substantial gap between rapidly expanding technical capabilities and evidence supporting real-world implementation. These findings provide a structured evidence base for prioritizing rigorous validation, transparent governance, and clinically meaningful evaluation as LLMs transition from experimental tools toward operational components of clinical research.

Research Square
Northwestern University (US), University of Minnesota (US), University of Illinois Urbana-Champaign (US), University of Washington (US), Arizona State University (US)
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon