Multimodal survival analysis of glioblastoma using whole-slide histopathology, gene expression, clinical variables and language-model-derived mutation features

Glioblastoma (GBM) is a highly aggressive brain tumor with poor prognosis, motivating the development of more accurate survival prediction models that can integrate complementary clinical and molecular information. However, existing multimodal survival frameworks often rely on simplified genomic summaries, underuse sequence-context information from mutations, or discard global spatial structure in whole-slide histopathology. In this study, we present MUSA , a multimodal survival framework that integrates three data sources: whole-slide H&E histopathology, tabular clinical and gene expression variables, and language-model-derived mutation features. For histopathology, we use a class-map-based feature extraction pipeline that summarizes slide-level composition, spatial adjacency, and fragmentation patterns. For the molecular branch, we represent missense mutations using protein-sequence-context-based features derived from a language model and evaluate both frozen and survival-supervised representations. These modality-specific features are then fused within a survival prediction framework and evaluated under nested cross-validation. In mutation-only experiments, survival-supervised language-model features outperformed one-hot and VEP-derived baselines. In multimodal benchmark comparisons, MUSA outperformed matched reference models, and in ablation analyses the full trimodal model achieved the best overall median concordance. Together, these results show that mutation-sequence representations and spatial histopathology features provide complementary prognostic information for GBM survival modeling.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-04-21
DOI
https://doi.org/10.1038/s41598-026-48666-1
Primary Topic
Glioma Diagnosis and Treatment
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal survival analysis of glioblastoma using whole-slide histopathology, gene expression, clinical variables and language-model-derived mutation features

Paul Martin Brennan, Ajitha Rajan, Javier Alfaro, Tongjie Wang
Scientific Reports
Glioma Diagnosis and Treatment
article

Multimodal survival analysis of glioblastoma using whole-slide histopathology, gene expression, clinical variables and language-model-derived mutation features

Paul Martin Brennan, Ajitha Rajan, Javier Alfaro, Tongjie Wang
article en

Abstract

Glioblastoma (GBM) is a highly aggressive brain tumor with poor prognosis, motivating the development of more accurate survival prediction models that can integrate complementary clinical and molecular information. However, existing multimodal survival frameworks often rely on simplified genomic summaries, underuse sequence-context information from mutations, or discard global spatial structure in whole-slide histopathology. In this study, we present MUSA , a multimodal survival framework that integrates three data sources: whole-slide H&E histopathology, tabular clinical and gene expression variables, and language-model-derived mutation features. For histopathology, we use a class-map-based feature extraction pipeline that summarizes slide-level composition, spatial adjacency, and fragmentation patterns. For the molecular branch, we represent missense mutations using protein-sequence-context-based features derived from a language model and evaluate both frozen and survival-supervised representations. These modality-specific features are then fused within a survival prediction framework and evaluated under nested cross-validation. In mutation-only experiments, survival-supervised language-model features outperformed one-hot and VEP-derived baselines. In multimodal benchmark comparisons, MUSA outperformed matched reference models, and in ablation analyses the full trimodal model achieved the best overall median concordance. Together, these results show that mutation-sequence representations and spatial histopathology features provide complementary prognostic information for GBM survival modeling.

Scientific Reports
NHS Lothian (GB), Edinburgh Cancer Research (GB), MRC Centre for Regenerative Medicine (GB), University of Edinburgh (GB)
Horizon 2020
No poverty
Openalex Percentile: Top 15%
Glioma Diagnosis and Treatment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.