Diagnostic and interpretive gains from reasoning over conclusions with a large reasoning model in radiology

Radiologists can miss subtle secondary findings relevant to tumor staging and management. Large reasoning models (LRMs) may mitigate this by improving interpretive completeness and transparency, yet systematic evaluation remains lacking. We studied 900 multicenter oncologic cases from three Chinese hospitals to compare an LRM's reasoning processes with its conclusion-only format and two non-reasoning models. Three senior radiologists assessed diagnostic errors and qualitative attributes, and a human-in-the-loop study with six radiologists evaluated workflow-related effects. Cross-language generalization was tested using an English MIMIC-Cancer-90 cohort. Reasoning processes showed the fewest missed or misclassified errors and the highest ratings for comprehensiveness, explainability, and unbiasedness, though with reduced conciseness. Performance dropped when only conclusions were used, and non-reasoning models underperformed across metrics. Improvements were consistent across cancer types, modalities, institutions, and languages. Reader studies confirmed greater perceived completeness and reasoning clarity, especially among juniors, while revealing workflow costs requiring optimization for clinical use.

Authors

Institutions

Publication Details

Journal
npj Digital Medicine
Published
2025-12-31
DOI
https://doi.org/10.1038/s41746-025-02285-8
Primary Topic
Clinical Reasoning and Diagnostic Skills
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Diagnostic and interpretive gains from reasoning over conclusions with a large reasoning model in radiology

Zhiyuan Wang, Yisong Wang, Guoping Tan, Wei Zhao et al.
npj Digital Medicine
Clinical Reasoning and Diagnostic Skills
article

Diagnostic and interpretive gains from reasoning over conclusions with a large reasoning model in radiology

Zhiyuan Wang, Yisong Wang, Guoping Tan, Wei Zhao, Chao Zheng, Sihong Huang, Jun Liu, Ruixin Wang, Jinghang Wang, Shaoliang Peng, Xiaohui Liu
article en

Abstract

Radiologists can miss subtle secondary findings relevant to tumor staging and management. Large reasoning models (LRMs) may mitigate this by improving interpretive completeness and transparency, yet systematic evaluation remains lacking. We studied 900 multicenter oncologic cases from three Chinese hospitals to compare an LRM's reasoning processes with its conclusion-only format and two non-reasoning models. Three senior radiologists assessed diagnostic errors and qualitative attributes, and a human-in-the-loop study with six radiologists evaluated workflow-related effects. Cross-language generalization was tested using an English MIMIC-Cancer-90 cohort. Reasoning processes showed the fewest missed or misclassified errors and the highest ratings for comprehensiveness, explainability, and unbiasedness, though with reduced conciseness. Performance dropped when only conclusions were used, and non-reasoning models underperformed across metrics. Improvements were consistent across cancer types, modalities, institutions, and languages. Reader studies confirmed greater perceived completeness and reasoning clarity, especially among juniors, while revealing workflow costs requiring optimization for clinical use.

npj Digital MedicineVol. 9(1)
Jiangsu University (CN), Central South University (CN), Hohai University (CN), Hunan University (CN), First People's Hospital of Kunshan (CN), Hunan Cancer Hospital (CN), The First People's Hospital of Changde (CN), Second Xiangya Hospital of Central South University (CN)
Innovative Research Group Project of the National Natural Science Foundation of China, National Natural Science Foundation of China, Natural Science Foundation of Hunan Province, Fundo para o Desenvolvimento das Ciências e da Tecnologia, Xiangya Hospital, Central South University
Quality Education
Openalex Percentile: Top 27%
Clinical Reasoning and Diagnostic Skills
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.