Interpretable multimodal PET/CT-EHR fusion via mixture-of-experts for prognostic stratification in mantle cell lymphoma: a multicenter study

BACKGROUND: F]FDG PET/CT and electronic health record (EHR) data for individualized risk stratification. METHODS: In this multicenter study, 187 treatment-naïve MCL patients were analyzed. A mixture-of-experts (MoE) fusion network integrated multimodal representations from PET/CT and EHR data. Expert modules comprising vision encoders, radiomics extractors, and a medical language model were integrated through an attention-based gating mechanism to construct multimodal radiomic signatures (R-signatures) predictive of progression-free survival (PFS) and overall survival (OS). R-signatures were validated and incorporated with clinical and metabolic factors into multiparametric models. Deep learning model interpretability was evaluated using attention visualization, expert-level contributions and pathologic correlation. RESULTS: R-signatures robustly discriminated relapse (AUC = 0.893 training, 0.755 validation) and death (AUC = 0.804 and 0.844), and independently predicted adverse outcomes (PFS: HR = 27.70, P < 0.001; OS: HR = 6.86, P = 0.001). Multiparametric models integrating R-signatures with total lesion glycolysis, β2-microglobulin, WBC, and Ki-67 outperformed conventional indices (C-indices: PFS 0.892 training, 0.781 validation; OS 0.877 training, 0.862 validation). Time-dependent ROC analyses consistently showed AUCs approaching or exceeding 0.800. Calibration and decision curve analyses confirmed excellent agreement and superior clinical net benefit. Attention maps localized high-weighted regions to hypermetabolic tumor areas, with higher R-signature values in blastoid and pleomorphic variants versus classical histology (P = 0.028 and P = 0.010). CONCLUSIONS: This interpretable PET/CT-EHR fusion framework substantially improves prognostic precision in MCL, providing a noninvasive, clinically translatable tool for risk-adapted management.

Authors

Institutions

Publication Details

Journal
BMC Medicine
Published
2026-04-16
DOI
https://doi.org/10.1186/s12916-026-04865-1
Primary Topic
Radiomics and Machine Learning in Medical Imaging
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Interpretable multimodal PET/CT-EHR fusion via mixture-of-experts for prognostic stratification in mantle cell lymphoma: a multicenter study

Linhao Qu, Limin Gao, Chongyang Ding, Z Zhang et al.
BMC Medicine
Radiomics and Machine Learning in Medical Imaging
article

Interpretable multimodal PET/CT-EHR fusion via mixture-of-experts for prognostic stratification in mantle cell lymphoma: a multicenter study

Linhao Qu, Limin Gao, Chongyang Ding, Z Zhang, Rong Tian, Yue Teng, Zekun Jiang, Chong Jiang, Ming Jiang
article en

Abstract

BACKGROUND: F]FDG PET/CT and electronic health record (EHR) data for individualized risk stratification. METHODS: In this multicenter study, 187 treatment-naïve MCL patients were analyzed. A mixture-of-experts (MoE) fusion network integrated multimodal representations from PET/CT and EHR data. Expert modules comprising vision encoders, radiomics extractors, and a medical language model were integrated through an attention-based gating mechanism to construct multimodal radiomic signatures (R-signatures) predictive of progression-free survival (PFS) and overall survival (OS). R-signatures were validated and incorporated with clinical and metabolic factors into multiparametric models. Deep learning model interpretability was evaluated using attention visualization, expert-level contributions and pathologic correlation. RESULTS: R-signatures robustly discriminated relapse (AUC = 0.893 training, 0.755 validation) and death (AUC = 0.804 and 0.844), and independently predicted adverse outcomes (PFS: HR = 27.70, P < 0.001; OS: HR = 6.86, P = 0.001). Multiparametric models integrating R-signatures with total lesion glycolysis, β2-microglobulin, WBC, and Ki-67 outperformed conventional indices (C-indices: PFS 0.892 training, 0.781 validation; OS 0.877 training, 0.862 validation). Time-dependent ROC analyses consistently showed AUCs approaching or exceeding 0.800. Calibration and decision curve analyses confirmed excellent agreement and superior clinical net benefit. Attention maps localized high-weighted regions to hypermetabolic tumor areas, with higher R-signature values in blastoid and pleomorphic variants versus classical histology (P = 0.028 and P = 0.010). CONCLUSIONS: This interpretable PET/CT-EHR fusion framework substantially improves prognostic precision in MCL, providing a noninvasive, clinically translatable tool for risk-adapted management.

BMC Medicine
Shanghai Medical College of Fudan University (CN), Sichuan University (CN), Fudan University (CN), West China Medical Center of Sichuan University (CN), West China Hospital of Sichuan University (CN), Nanjing Drum Tower Hospital (CN), Jiangsu Province Hospital (CN), Nanjing Medical University (CN)
National Natural Science Foundation of China, China Postdoctoral Science Foundation
Reduced inequalities
Openalex Percentile: Top 13%
Radiomics and Machine Learning in Medical Imaging
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.