Beyond Reporting: Claude 3.7 Sonnet Accurately Classifies T Stage and Uncovers Omitted Anatomic Invasion in Nasopharyngeal Carcinoma Magnetic Resonance Imaging (MRI) Reports
Purpose This study aimed to determine whether Claude 3.7 Sonnet (Anthropic, San Francisco, CA, USA), a large language model (LLM), can (i) assign nasopharyngeal carcinoma (NPC) T classification from routine magnetic resonance imaging (MRI) reports and (ii) identify unreported anatomical structures whose invasion would warrant a higher T stage. Materials and methods This single-institution retrospective study included 38 consecutive patients (31 men; mean age 59.7±14.9 years) who underwent pretreatment MRI for NPC between April 1999 and March 2025. De-identified unstructured "Findings" sections were submitted once to Claude 3.7 Sonnet (temperature=0), prompting the model to assign a T stage according to the American Joint Committee on Cancer/Union for International Cancer Control 9th Edition and to list potentially missed invasive sites. Reference-standard staging and relevant omissions were established independently by two radiologists. Model accuracy for T classification and for detecting missing structures was calculated; false-positive flags were recorded. Radiologists re-evaluated MR images for any stage change prompted by the LLM. Results The LLM reproduced the reference T category in 35/38 patients (92.1%). Category-specific accuracy was 100% for T1 (9/9) and T4 (13/13), 90% for T3 (9/10), and 66.7% for T2 (4/6). Among 208 eligible unmentioned structures, the model correctly flagged 81 (38.9%), with a mean of 3.34 false-positive suggestions per case. Subsequent human review confirmed stage upgrades in 2/38 patients (5.3%), both corrected to T4 based on intracranial extension or cranial nerve involvement noted by the LLM. Conclusion Claude 3.7 Sonnet achieved high accuracy in T staging from unstructured free-text MRI reports for NPC and identified clinically important omissions, enabling radiologists to correct staging in select cases. LLM-assisted report auditing may improve staging quality and serve as an educational aid where subspecialty expertise is limited.
Authors
- Ryo Kurokawa (ORCID: https://orcid.org/0000-0002-1186-8900)
- Satoshi Hatano
- Akifumi Hagiwara (ORCID: https://orcid.org/0000-0001-5277-3249)
- Osamu Abe (ORCID: https://orcid.org/0000-0002-1180-2629)
- Shota Fujisawa
- Yusuke Asari
- Mariko Kurokawa (ORCID: https://orcid.org/0000-0002-3907-9188)
- Wataru Gonoi (ORCID: https://orcid.org/0000-0002-5018-4683)
- Jun Kanzawa (ORCID: https://orcid.org/0009-0008-8203-8665)
- Yuki Sonoda (ORCID: https://orcid.org/0009-0005-8622-2433)
Institutions
- Juntendo University (JP)
- University of Tokyo Hospital (JP)
- Juntendo University Hospital (JP)
Publication Details
- Journal
- Cureus
- Published
- 2025-08-28
- DOI
- https://doi.org/10.7759/cureus.91209
- Primary Topic
- Head and Neck Cancer Studies
- Type
- article
- Field-Weighted Citation Impact
- 0.00