Agent-based large language model system for extracting structured data from breast cancer synoptic reports: a dual-validation study

While LLM-based extraction systems show promise for pathology data extraction, synthetic validation alone provides false confidence. Rigorous real-world ground truth evaluation with expert annotation is essential before clinical deployment. These systems are best positioned as screening tools with mandatory human oversight rather than autonomous decision-making systems.

Authors

Institutions

Publication Details

Journal
JAMIA Open
Published
2026-01-06
DOI
https://doi.org/10.1093/jamiaopen/ooag016
Primary Topic
AI in cancer detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Agent-based large language model system for extracting structured data from breast cancer synoptic reports: a dual-validation study

Teya S. Bergamaschi, S. N. Hart
JAMIA Open
AI in cancer detection
article

Agent-based large language model system for extracting structured data from breast cancer synoptic reports: a dual-validation study

Teya S. Bergamaschi, S. N. Hart
article en

Abstract

While LLM-based extraction systems show promise for pathology data extraction, synthetic validation alone provides false confidence. Rigorous real-world ground truth evaluation with expert annotation is essential before clinical deployment. These systems are best positioned as screening tools with mandatory human oversight rather than autonomous decision-making systems.

JAMIA OpenVol. 9(1)
Mayo Clinic (US), Mayo Clinic in Arizona (US), Mayo Clinic in Florida (US), Massachusetts Institute of Technology (US)
Good health and well-being
Openalex Percentile: Top 46%
AI in cancer detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.