Skill-guided agentic reasoning enables longitudinal synthesis of myeloma records at expert-level concordance

Patients with multiple myeloma accumulate hundreds of clinical documents over years of sequential therapy, and every treatment decision depends on synthesis across that history. Whether large language model-based systems can match expert agreement on this task, and where they fail, has not been established. On longitudinal records of 811 patients treated over 25 years (44,962 documents and 1,334,677 laboratory values), an agentic reasoning system guided by an indexed clinical skill library was compared against single-pass retrieval-augmented generation (RAG), iterative RAG, iterative RAG augmented with the same skill library, and full-context input on 469 expert-adjudicated patient-question pairs, with an exploratory cross-dataset evaluation on MIMIC-IV. The skill-guided agent exceeded the ceiling at which iterative RAG (75.7%) and full-context input (75.8%) converged, reaching 80.1% concordance, with its advantage widening on the most complex tasks (+11.2 percentage points) and longest records. Providing the same skill library to iterative RAG matched the agent in aggregate (79.0%) and on shorter records, whereas the agent retained a significant advantage on the longest records (+10.3 percentage points in the top decile, p = 0.017) and a numerical, non-significant advantage on the most complex questions (+5.4 percentage points). The aggregate error rate (12.2%) was comparable to expert disagreement (13.6%), but a higher proportion of system errors were clinically significant (57.8 versus 18.8%).

Authors

Institutions

Publication Details

Journal
npj Precision Oncology
Published
2026-10-14
DOI
https://doi.org/10.1038/s41698-026-01733-2
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Skill-guided agentic reasoning enables longitudinal synthesis of myeloma records at expert-level concordance

Marion Högner, Lisa C. Adams, Keno K. Bressem, Sebastian Ziegelmayer et al.
npj Precision Oncology
Artificial Intelligence in Healthcare and Education
article

Skill-guided agentic reasoning enables longitudinal synthesis of myeloma records at expert-level concordance

Marion Högner, Lisa C. Adams, Keno K. Bressem, Sebastian Ziegelmayer, Jacqueline Lammert, Florian C. Bassermann, Anirudh Narayanan, Anna Purcarea, Jacob Stroh, Jannik Lübberstedt, Friedrich Puttkammer, Hartmut Häntze, Christoph Nuernbergk, Luisa Mertens, Daniel Rueckert, Johannes Moll, Fabian Drexel, Zeineb Benchaaben, Andrei Zhukov, Christopher Zirn, Markus Graf, Krischan Braitsch, Marcus Makowski, Jiazhen Pan
article en

Abstract

Patients with multiple myeloma accumulate hundreds of clinical documents over years of sequential therapy, and every treatment decision depends on synthesis across that history. Whether large language model-based systems can match expert agreement on this task, and where they fail, has not been established. On longitudinal records of 811 patients treated over 25 years (44,962 documents and 1,334,677 laboratory values), an agentic reasoning system guided by an indexed clinical skill library was compared against single-pass retrieval-augmented generation (RAG), iterative RAG, iterative RAG augmented with the same skill library, and full-context input on 469 expert-adjudicated patient-question pairs, with an exploratory cross-dataset evaluation on MIMIC-IV. The skill-guided agent exceeded the ceiling at which iterative RAG (75.7%) and full-context input (75.8%) converged, reaching 80.1% concordance, with its advantage widening on the most complex tasks (+11.2 percentage points) and longest records. Providing the same skill library to iterative RAG matched the agent in aggregate (79.0%) and on shorter records, whereas the agent retained a significant advantage on the longest records (+10.3 percentage points in the top decile, p = 0.017) and a numerical, non-significant advantage on the most complex questions (+5.4 percentage points). The aggregate error rate (12.2%) was comparable to expert disagreement (13.6%), but a higher proportion of system errors were clinically significant (57.8 versus 18.8%).

npj Precision OncologyVol. 10(1)
TUM Klinikum (DE), Humboldt-Universität zu Berlin (DE), University of Oxford (GB), National Center for Tumor Diseases (DE), Essen University Hospital (DE), German Marine Research Consortium (DE), Deutsches Herzzentrum München (DE), Munich Center for Machine Learning, Imperial College London (GB), Technical University of Munich (DE), Freie Universität Berlin (DE), Charité - Universitätsmedizin Berlin (DE)
Bayern Innovativ, Deutsche Forschungsgemeinschaft
Good health and well-being
Openalex Percentile: Top 21%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.