Standardized pre-consultation by a large language model agent vs ophthalmology residents: a randomized clinical trial

History-taking is central yet constrained by limited clinical resources. We designed a pre-consultation large language model (LLM) agent for history-taking using a dual-agent architecture with skills-engineered symptom-oriented logic trees, and conducted a randomized clinical trial at a tertiary ophthalmic hospital in Guangzhou, China. Between May 10 and June 10, 2025, 172 of 175 approached patients with non-emergency appointments were randomized 1:1 to this LLM agent or ophthalmology residents. Among randomized patients (median age 56 years; 55% female), the LLM agent achieved better pre-consultation quality, measured by MedHistory score (range 0–100; adjusted mean difference, 17.7 points; 95% CI, 14.1 to 21.3; P < 0.001). It also received higher patience and empathy ratings (5 vs 4 and 5 vs 3 points, respectively; both P < 0.001), and had longer interactions (median 11.2 vs 3.1 minutes; P < 0.001). Test recommendation performance did not differ significantly across stages. Exploratory analyses showed the agent achieved superior diagnostic accuracy from history alone (F1 score 0.85 vs 0.68; P < 0.001), whereas ocular signs produced greater improvement among residents (interaction effect -0.19; P = 0.003), significantly narrowing the gap. These findings suggest engineered LLM agents can standardize clinical data acquisition, supporting a hybrid workflow where clinicians prioritize their expertise for physical examination and diagnostic synthesis. Trial Registration: ClinicalTrials.gov, NCT06824389, 02/05/2025.

Authors

Institutions

Publication Details

Journal
npj Digital Medicine
Published
2026-10-05
DOI
https://doi.org/10.1038/s41746-026-03232-x
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Standardized pre-consultation by a large language model agent vs ophthalmology residents: a randomized clinical trial

Xiaohang Wu, Meimei Dongye, Jianyu Pang, Shaowei Bi et al.
npj Digital Medicine
Artificial Intelligence in Healthcare and Education
article

Standardized pre-consultation by a large language model agent vs ophthalmology residents: a randomized clinical trial

Xiaohang Wu, Meimei Dongye, Jianyu Pang, Shaowei Bi, Zhenzhen Liu, Jingrui Wang, Wei Qiang Wang, Mingjie Luo, Haotian Lin, Yunxi Lai, Yue Wu, Jingjing Chen, Zhenzhe Lin, Ling Jin
article en

Abstract

History-taking is central yet constrained by limited clinical resources. We designed a pre-consultation large language model (LLM) agent for history-taking using a dual-agent architecture with skills-engineered symptom-oriented logic trees, and conducted a randomized clinical trial at a tertiary ophthalmic hospital in Guangzhou, China. Between May 10 and June 10, 2025, 172 of 175 approached patients with non-emergency appointments were randomized 1:1 to this LLM agent or ophthalmology residents. Among randomized patients (median age 56 years; 55% female), the LLM agent achieved better pre-consultation quality, measured by MedHistory score (range 0–100; adjusted mean difference, 17.7 points; 95% CI, 14.1 to 21.3; P < 0.001). It also received higher patience and empathy ratings (5 vs 4 and 5 vs 3 points, respectively; both P < 0.001), and had longer interactions (median 11.2 vs 3.1 minutes; P < 0.001). Test recommendation performance did not differ significantly across stages. Exploratory analyses showed the agent achieved superior diagnostic accuracy from history alone (F1 score 0.85 vs 0.68; P < 0.001), whereas ocular signs produced greater improvement among residents (interaction effect -0.19; P = 0.003), significantly narrowing the gap. These findings suggest engineered LLM agents can standardize clinical data acquisition, supporting a hybrid workflow where clinicians prioritize their expertise for physical examination and diagnostic synthesis. Trial Registration: ClinicalTrials.gov, NCT06824389, 02/05/2025.

npj Digital Medicine
Sun Yat-sen University (CN), Hainan Eye Hospital (CN), Zhongshan Ophthalmic Center, Sun Yat-sen University
Openalex Percentile: Top 18%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.