A concept-guided multimodal mixture-of-experts framework for lung cancer diagnosis and prognosis prediction

Accurate lung cancer assessment requires integrating histopathological morphology, molecular alterations, and prognostic risk. However, most computational pathology models are either task-specific or rely on high-dimensional multimodal fusion that provides limited insight into how image-derived and genomic evidence jointly supports a clinical decision. We propose CONCERTO, a concept-guided multimodal mixture-of-experts framework for multi-endpoint lung cancer analysis. The model integrates whole-slide images (WSIs) with genomics data, decomposes multimodal evidence into image-specific, omics-specific, redundant, and synergistic expert pathways, and maps expert representations to hierarchical morphology and molecular concepts. Across TCGA lung cancer tasks, CONCERTO demonstrates strong performance in subtype classification, molecular alteration prediction, and survival prediction. Ablation studies further support the contribution of concept bottlenecks, hierarchical concept organization, and interaction-aware expert specialization. These results suggest a scalable route toward multimodal lung cancer AI that is both predictive and interpretable.

Authors

Institutions

Publication Details

Journal
Frontiers in Oncology
Published
2026-11-18
DOI
https://doi.org/10.3389/fonc.2026.1957081
Primary Topic
AI in cancer detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

A concept-guided multimodal mixture-of-experts framework for lung cancer diagnosis and prognosis prediction

李俞慧, Ting Wang, Fei Ye, Rongshan Zheng et al.
3 links
Frontiers in Oncology
AI in cancer detection
article

A concept-guided multimodal mixture-of-experts framework for lung cancer diagnosis and prognosis prediction

李俞慧, Ting Wang, Fei Ye, Rongshan Zheng, Ling Weng, Hongying Zhang, Limin Chen
article en

Abstract

Accurate lung cancer assessment requires integrating histopathological morphology, molecular alterations, and prognostic risk. However, most computational pathology models are either task-specific or rely on high-dimensional multimodal fusion that provides limited insight into how image-derived and genomic evidence jointly supports a clinical decision. We propose CONCERTO, a concept-guided multimodal mixture-of-experts framework for multi-endpoint lung cancer analysis. The model integrates whole-slide images (WSIs) with genomics data, decomposes multimodal evidence into image-specific, omics-specific, redundant, and synergistic expert pathways, and maps expert representations to hierarchical morphology and molecular concepts. Across TCGA lung cancer tasks, CONCERTO demonstrates strong performance in subtype classification, molecular alteration prediction, and survival prediction. Ablation studies further support the contribution of concept bottlenecks, hierarchical concept organization, and interaction-aware expert specialization. These results suggest a scalable route toward multimodal lung cancer AI that is both predictive and interpretable.

Frontiers in OncologyVol. 16
Fuzhou Pulmonary Hospital of Fujian (CN), Union Hospital (CN)
Good health and well-being
AI in cancer detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon