DSAI-03 DEEP LEARNING-BASED PREDICTION OF IMMUNE CHECKPOINT INHIBITOR EFFICACY IN BRAIN METASTASES USING BRAIN MRI

Abstract Brain metastases (BM) are an emerging challenge in modern oncology due to increasing incidence and limited treatments. Recent work by our group and others has illustrated that immune checkpoint inhibitors (ICI) are a promising therapy for treatment-refractory BM of diverse histologies. To build upon our findings and integrate ICI into precision medicine strategies for BM, scalable tools that quantify likelihood of response are needed. We curated a multi-institutional dataset of longitudinal mpMRI for 860 BM patients treated with ICI, assessing 2,542 BM responses based on pre- and 6-month post-treatment MRIs using standardized RANO criteria. A convolutional neural network (CNN) trained on pre-treatment mpMRI sequences predicted 6-month ICI efficacy. To ensure class balance and clinical relevance, four RANO classes were converted into a binary model: intracranial benefit including complete response (CR), partial response (PR) and stable disease (SD) vs. progressive disease (PD). Our custom CNN consists of three convolutional and two fully connected layers, with an 80/20 train-validation split. We also developed a "foundation model" for brain metastases using self-supervised contrastive learning on 21,179 BM private and public mpMRIs from more than 15,000 patients with a 3D ResNet50 architecture. The model was fine-tuned for ICI efficacy prediction using the same dataset that trained the CNN, held out during pretraining. A logistic regression model was trained on features extracted from the foundation model. Our CNN achieved an AUROC score of 0.650 on the validation set. Fine-tuning the foundation model with a linear classifier improved AUROC to 0.7904. Ongoing work includes optimizing models, developing multi-class response models (e.g., CR/PR vs. SD vs. PD), and conducting histology-specific analyses. Our study presents one of the first Deep Learning-based efforts to predict ICI efficacy for BM. There is emerging promise in using Deep Learning to identify imaging patterns of biological significance within clinically acquired imaging.

Authors

Institutions

Publication Details

Journal
Neuro-Oncology Advances
Published
2025-08-01
DOI
https://doi.org/10.1093/noajnl/vdaf123.036
Primary Topic
Brain Metastases and Treatment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

DSAI-03 DEEP LEARNING-BASED PREDICTION OF IMMUNE CHECKPOINT INHIBITOR EFFICACY IN BRAIN METASTASES USING BRAIN MRI

Bruce Robert Rosen, Joseph Tiran, Andrea Dell’Orco, Nelson Gil et al.
Neuro-Oncology Advances
Brain Metastases and Treatment
article

DSAI-03 DEEP LEARNING-BASED PREDICTION OF IMMUNE CHECKPOINT INHIBITOR EFFICACY IN BRAIN METASTASES USING BRAIN MRI

Bruce Robert Rosen, Joseph Tiran, Andrea Dell’Orco, Nelson Gil, Shreyas Bhat Brahmavar, Jayashree Kalpathy–Cramer, Jawed Nawabi, Albert E. Kim, Jay Patel, Christopher P. Bridge, Elizabeth Robins Gerstner, David Wasilewski, Felix J. Dorfner, Tobias R. Bodenmann, Dagoberto Pulido-Arias, Melisa S. Guelen, Mason C. Cleveland
article en

Abstract

Abstract Brain metastases (BM) are an emerging challenge in modern oncology due to increasing incidence and limited treatments. Recent work by our group and others has illustrated that immune checkpoint inhibitors (ICI) are a promising therapy for treatment-refractory BM of diverse histologies. To build upon our findings and integrate ICI into precision medicine strategies for BM, scalable tools that quantify likelihood of response are needed. We curated a multi-institutional dataset of longitudinal mpMRI for 860 BM patients treated with ICI, assessing 2,542 BM responses based on pre- and 6-month post-treatment MRIs using standardized RANO criteria. A convolutional neural network (CNN) trained on pre-treatment mpMRI sequences predicted 6-month ICI efficacy. To ensure class balance and clinical relevance, four RANO classes were converted into a binary model: intracranial benefit including complete response (CR), partial response (PR) and stable disease (SD) vs. progressive disease (PD). Our custom CNN consists of three convolutional and two fully connected layers, with an 80/20 train-validation split. We also developed a "foundation model" for brain metastases using self-supervised contrastive learning on 21,179 BM private and public mpMRIs from more than 15,000 patients with a 3D ResNet50 architecture. The model was fine-tuned for ICI efficacy prediction using the same dataset that trained the CNN, held out during pretraining. A logistic regression model was trained on features extracted from the foundation model. Our CNN achieved an AUROC score of 0.650 on the validation set. Fine-tuning the foundation model with a linear classifier improved AUROC to 0.7904. Ongoing work includes optimizing models, developing multi-class response models (e.g., CR/PR vs. SD vs. PD), and conducting histology-specific analyses. Our study presents one of the first Deep Learning-based efforts to predict ICI efficacy for BM. There is emerging promise in using Deep Learning to identify imaging patterns of biological significance within clinically acquired imaging.

Neuro-Oncology AdvancesVol. 7(Supplement_2)
Massachusetts General Hospital (US), Düsseldorf University Hospital (DE), Heinrich Heine University Düsseldorf (DE), École Polytechnique Fédérale de Lausanne (CH), University of Colorado Anschutz Medical Campus (US), Charité - Universitätsmedizin Berlin (DE)
Partnerships for the goals
Openalex Percentile: Top 69%
Brain Metastases and Treatment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.