Automated Intracranial Aneurysm Detection and Size Extraction from Imaging Reports Using a Dual-Model Transformer Framework
Abstract Background The unstructured and variable nature of radiology reports remains a barrier to automated extraction of clinically relevant information for large-scale research and AI applications, particularly for intracranial aneurysms (IAs). Objective We aimed to develop and evaluate a dual-model transformer framework for intracranial aneurysm information extraction and assess whether structured processing improved classification and size-extraction performance compared with unstructured text. Methods We analyzed 3,183 neuroimaging reports annotated by neuroradiologists and neurosurgeons. Four encoder-based transformer models were evaluated for aneurysm-presence classification using 5-fold stratified cross-validation. A zero-shot Llama 3.1 framework was used to extract aneurysm size using direct and structured-report prompting. RadDistilBERT and Llama 3.1 were evaluated on 20 temporally distinct reports using full-report and impression-only inputs, with and without structured preprocessing. Results RadDistilBERT achieved the highest mean classification performance, with accuracy of 96.4% (± 1.8%), F1 score of 91.7% (± 10.3%), precision of 94.0% (± 4.6%), and recall of 90.7% (± 15.6%). F1 scores were 87.5% for BERT-base-uncased and 31.1% for ALBERT-base-v2. In the 20-report set, aneurysm-presence classification accuracy was 100% across all input and processing conditions. For aneurysm size extraction, structured report processing increased accuracy from 61.90% to 66.67% using the full report and from 80.95% to 85.00% using the impression section. Conclusions This study demonstrates the feasibility of a dual-model transformer framework for aneurysm-presence classification and size extraction from unstructured neuroimaging reports. RadDistilBERT achieved the strongest classification performance, while Llama 3.1 enabled zero-shot size extraction. These findings support further external validation and expansion to additional aneurysm characteristics with dedicated annotation and validation.
Authors
- Emily J. Winterhalter (ORCID: https://orcid.org/0000-0002-1506-6040)
- Donald Robert Cantrell (ORCID: https://orcid.org/0000-0002-2444-8948)
- Dillan Prasad (ORCID: https://orcid.org/0000-0002-2161-3282)
- Syed Hasib Akhter Faruqui (ORCID: https://orcid.org/0000-0002-5073-8690)
- Amr R. Alwakeal (ORCID: https://orcid.org/0000-0001-5440-3874)
- Rishi Jain (ORCID: https://orcid.org/0000-0003-4459-5504)
- Matthew Potts
- Nikhil Prasad
- Michael Oblich
Institutions
- Northwestern University (US)
- Sam Houston State University (US)
Publication Details
- Journal
- Research Square
- Published
- 2026-11-13
- DOI
- https://doi.org/10.21203/rs.3.rs-11435195/v1
- Primary Topic
- Topic Modeling
- Type
- preprint