Artificial intelligence-based intraoperative microscope image analysis for differentiating glioblastoma and brain metastases

Aim: Intraoperative differentiation between glioblastoma and brain metastases may influence surgical strategy. This study aimed to develop and internally validate an artificial intelligence (AI)-based model combining intraoperative microscopic images with clinical metadata for differentiation of glioblastoma and brain metastases. Methods: This retrospective single-center proof-of-concept study included 92 patients (46 glioblastomas, 46 metastases). A dual-branch neural network combining DINOv2 image features and clinical metadata was evaluated using patient-stratified 10-fold cross-validation. Patient-level classifications were aggregated by majority vote in a separate evaluation. Comparisons included a metadata-only model, an image-only ablation model and an information-restricted assessment by 13 neurosurgeons. Results: Pooled analysis of 6,984 out-of-fold frame predictions yielded balanced accuracy of 68.2%, with an area under the curve (AUC) of 0.726 (95%CI: 0.639-0.806). Patient-level accuracy was 71.7% (66/92), with an AUC of 0.791 (95%CI: 0.694-0.879). The metadata-only model achieved 70.7% accuracy (65/92) and an AUC of 0.779 (95%CI: 0.678-0.869). Classifications differed in 19/92 patients (20.7%). In the matched ablation analysis, mean frame-level accuracy was higher for the multimodal than image-only model (67.9% vs. 61.2%). Mean neurosurgeon accuracy was 52.8%, compared with 72.1% for a separately trained image-only hold-out model evaluated on the same selected frames. Conclusion: Multimodal analysis of selected intraoperative microscope images was technically feasible, but adding images to clinical metadata did not demonstrate an incremental benefit in patient-level classification accuracy. Prospective multicenter studies with external validation and assessment in continuous intraoperative workflows are required before clinical utility can be established.

Authors

Institutions

Publication Details

Journal
Artificial Intelligence Surgery
Published
2026-11-17
DOI
https://doi.org/10.20517/ais.2026.26
Primary Topic
Glioma Diagnosis and Treatment
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Artificial intelligence-based intraoperative microscope image analysis for differentiating glioblastoma and brain metastases

Stefan Saur, Nathalia Spier, Neal Bacher, Jessica Makolli et al.
1 links
Artificial Intelligence Surgery
Glioma Diagnosis and Treatment
article

Artificial intelligence-based intraoperative microscope image analysis for differentiating glioblastoma and brain metastases

Stefan Saur, Nathalia Spier, Neal Bacher, Jessica Makolli, Ammar Mallouhi, Christian Dorfer
article en

Abstract

Aim: Intraoperative differentiation between glioblastoma and brain metastases may influence surgical strategy. This study aimed to develop and internally validate an artificial intelligence (AI)-based model combining intraoperative microscopic images with clinical metadata for differentiation of glioblastoma and brain metastases. Methods: This retrospective single-center proof-of-concept study included 92 patients (46 glioblastomas, 46 metastases). A dual-branch neural network combining DINOv2 image features and clinical metadata was evaluated using patient-stratified 10-fold cross-validation. Patient-level classifications were aggregated by majority vote in a separate evaluation. Comparisons included a metadata-only model, an image-only ablation model and an information-restricted assessment by 13 neurosurgeons. Results: Pooled analysis of 6,984 out-of-fold frame predictions yielded balanced accuracy of 68.2%, with an area under the curve (AUC) of 0.726 (95%CI: 0.639-0.806). Patient-level accuracy was 71.7% (66/92), with an AUC of 0.791 (95%CI: 0.694-0.879). The metadata-only model achieved 70.7% accuracy (65/92) and an AUC of 0.779 (95%CI: 0.678-0.869). Classifications differed in 19/92 patients (20.7%). In the matched ablation analysis, mean frame-level accuracy was higher for the multimodal than image-only model (67.9% vs. 61.2%). Mean neurosurgeon accuracy was 52.8%, compared with 72.1% for a separately trained image-only hold-out model evaluated on the same selected frames. Conclusion: Multimodal analysis of selected intraoperative microscope images was technically feasible, but adding images to clinical metadata did not demonstrate an incremental benefit in patient-level classification accuracy. Prospective multicenter studies with external validation and assessment in continuous intraoperative workflows are required before clinical utility can be established.

Artificial Intelligence SurgeryVol. 6(4)
Carl Zeiss (Germany) (DE), Christian Doppler Laboratory for Thermoelectricity (AT), Universitätsklinikum St. Pölten (AT), Medical University of Vienna (AT)
Carl Zeiss Meditec AG, Medizinische Universität Wien
Good health and well-being
Glioma Diagnosis and Treatment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon