Unified multimodal learning for stroke triage: joint detection, scoring, and segmentation of acute ischemic stroke
Timely and accurate triage of acute ischemic stroke patients remains a critical challenge in clinical practice, particularly across heterogeneous imaging protocols and multicenter settings. Existing approaches often focus on isolated tasks such as large-vessel occlusion detection, collateral scoring, or infarct segmentation, leading to fragmented pipelines with limited generalizability and increased latency. In this work, we introduce a unified multimodal framework that jointly integrates non-contrast CT, CT angiography, and CT perfusion under a single encoder-decoder architecture. The system employs symmetry-aware encoders, graph-based vascular modeling, and spatio-temporal fusion, followed by multi-task heads for detection, grading, and segmentation. Trained and validated on multicenter datasets, the framework demonstrates consistent gains over state-of-the-art baselines: AUC improvements of up to +0.05 for LVO detection, a +0.11 increase in quadratic-weighted κ for collateral scoring, and a +5% Dice improvement with reduced volume error for infarct delineation. Beyond technical metrics, the model achieves clinically relevant impact by reducing mis-triage and unnecessary transfers while lowering inference time to under one minute in real-world PACS deployment. Ablation studies further confirm the synergistic benefit of multi-task optimization, which narrows the generalization gap and enhances robustness across unseen centers. Taken together, these results highlight the potential of unified multimodal learning to support fast, reliable, and scalable decision-making in acute stroke care.
Authors
- Pengcheng Liu (ORCID: https://orcid.org/0000-0003-0879-1970)
- Tengfei Luan
- Faqiang Zhang (ORCID: https://orcid.org/0000-0001-5502-6644)
- Song Hu (ORCID: https://orcid.org/0000-0002-3356-9450)
- Qiao Li (ORCID: https://orcid.org/0000-0001-9299-445X)
- Meihua Wang (ORCID: https://orcid.org/0000-0002-0115-1041)
- Gao Wu
- Hao Yang (ORCID: https://orcid.org/0009-0007-7437-1815)
- Ziyang Wang
- Dianbei Wang
- Weijun Huang
- Wenyu Zhou
Institutions
- Tongji University (CN)
- Hubei University of Medicine (CN)
- Aston University (GB)
- Zunyi Medical University (CN)
- Jilin University (CN)
- Chinese Academy of Sciences (CN)
- Zhejiang Cancer Hospital (CN)
- First Hospital of Jilin University (CN)
- Shanghai Pulmonary Hospital (CN)
- Universities of Giessen and Marburg Lung Center (DE)
- Shanghai Sixth People's Hospital (CN)
- Giessen School of Theology (DE)
- Institute of Natural Science (KP)
- Huashan Hospital (CN)
- Affiliated Hospital of Jining Medical University (CN)
- Shanghai Center for Brain Science and Brain-Inspired Technology (CN)
Publication Details
- Journal
- npj Digital Medicine
- Published
- 2026-04-13
- DOI
- https://doi.org/10.1038/s41746-025-02255-0
- Primary Topic
- Acute Ischemic Stroke Management
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China