Artificial intelligence-based intraoperative microscope image analysis for differentiating glioblastoma and brain metastases
Aim: Intraoperative differentiation between glioblastoma and brain metastases may influence surgical strategy. This study aimed to develop and internally validate an artificial intelligence (AI)-based model combining intraoperative microscopic images with clinical metadata for differentiation of glioblastoma and brain metastases. Methods: This retrospective single-center proof-of-concept study included 92 patients (46 glioblastomas, 46 metastases). A dual-branch neural network combining DINOv2 image features and clinical metadata was evaluated using patient-stratified 10-fold cross-validation. Patient-level classifications were aggregated by majority vote in a separate evaluation. Comparisons included a metadata-only model, an image-only ablation model and an information-restricted assessment by 13 neurosurgeons. Results: Pooled analysis of 6,984 out-of-fold frame predictions yielded balanced accuracy of 68.2%, with an area under the curve (AUC) of 0.726 (95%CI: 0.639-0.806). Patient-level accuracy was 71.7% (66/92), with an AUC of 0.791 (95%CI: 0.694-0.879). The metadata-only model achieved 70.7% accuracy (65/92) and an AUC of 0.779 (95%CI: 0.678-0.869). Classifications differed in 19/92 patients (20.7%). In the matched ablation analysis, mean frame-level accuracy was higher for the multimodal than image-only model (67.9% vs. 61.2%). Mean neurosurgeon accuracy was 52.8%, compared with 72.1% for a separately trained image-only hold-out model evaluated on the same selected frames. Conclusion: Multimodal analysis of selected intraoperative microscope images was technically feasible, but adding images to clinical metadata did not demonstrate an incremental benefit in patient-level classification accuracy. Prospective multicenter studies with external validation and assessment in continuous intraoperative workflows are required before clinical utility can be established.
Authors
- Stefan Saur
- Nathalia Spier
- Neal Bacher
- Jessica Makolli
- Ammar Mallouhi (ORCID: https://orcid.org/0000-0003-2232-7330)
- Christian Dorfer
Institutions
- Carl Zeiss (Germany) (DE)
- Christian Doppler Laboratory for Thermoelectricity (AT)
- Universitätsklinikum St. Pölten (AT)
- Medical University of Vienna (AT)
Publication Details
- Journal
- Artificial Intelligence Surgery
- Published
- 2026-11-17
- DOI
- https://doi.org/10.20517/ais.2026.26
- Primary Topic
- Glioma Diagnosis and Treatment
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Carl Zeiss Meditec AG
- Medizinische Universität Wien