Unified multimodal learning for stroke triage: joint detection, scoring, and segmentation of acute ischemic stroke

Timely and accurate triage of acute ischemic stroke patients remains a critical challenge in clinical practice, particularly across heterogeneous imaging protocols and multicenter settings. Existing approaches often focus on isolated tasks such as large-vessel occlusion detection, collateral scoring, or infarct segmentation, leading to fragmented pipelines with limited generalizability and increased latency. In this work, we introduce a unified multimodal framework that jointly integrates non-contrast CT, CT angiography, and CT perfusion under a single encoder-decoder architecture. The system employs symmetry-aware encoders, graph-based vascular modeling, and spatio-temporal fusion, followed by multi-task heads for detection, grading, and segmentation. Trained and validated on multicenter datasets, the framework demonstrates consistent gains over state-of-the-art baselines: AUC improvements of up to +0.05 for LVO detection, a +0.11 increase in quadratic-weighted κ for collateral scoring, and a +5% Dice improvement with reduced volume error for infarct delineation. Beyond technical metrics, the model achieves clinically relevant impact by reducing mis-triage and unnecessary transfers while lowering inference time to under one minute in real-world PACS deployment. Ablation studies further confirm the synergistic benefit of multi-task optimization, which narrows the generalization gap and enhances robustness across unseen centers. Taken together, these results highlight the potential of unified multimodal learning to support fast, reliable, and scalable decision-making in acute stroke care.

Authors

Institutions

Publication Details

Journal
npj Digital Medicine
Published
2026-04-13
DOI
https://doi.org/10.1038/s41746-025-02255-0
Primary Topic
Acute Ischemic Stroke Management
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Unified multimodal learning for stroke triage: joint detection, scoring, and segmentation of acute ischemic stroke

Pengcheng Liu, Tengfei Luan, Faqiang Zhang, Song Hu et al.
npj Digital Medicine
Acute Ischemic Stroke Management
article

Unified multimodal learning for stroke triage: joint detection, scoring, and segmentation of acute ischemic stroke

Pengcheng Liu, Tengfei Luan, Faqiang Zhang, Song Hu, Qiao Li, Meihua Wang, Gao Wu, Hao Yang, Ziyang Wang, Dianbei Wang, Weijun Huang, Wenyu Zhou
article en

Abstract

Timely and accurate triage of acute ischemic stroke patients remains a critical challenge in clinical practice, particularly across heterogeneous imaging protocols and multicenter settings. Existing approaches often focus on isolated tasks such as large-vessel occlusion detection, collateral scoring, or infarct segmentation, leading to fragmented pipelines with limited generalizability and increased latency. In this work, we introduce a unified multimodal framework that jointly integrates non-contrast CT, CT angiography, and CT perfusion under a single encoder-decoder architecture. The system employs symmetry-aware encoders, graph-based vascular modeling, and spatio-temporal fusion, followed by multi-task heads for detection, grading, and segmentation. Trained and validated on multicenter datasets, the framework demonstrates consistent gains over state-of-the-art baselines: AUC improvements of up to +0.05 for LVO detection, a +0.11 increase in quadratic-weighted κ for collateral scoring, and a +5% Dice improvement with reduced volume error for infarct delineation. Beyond technical metrics, the model achieves clinically relevant impact by reducing mis-triage and unnecessary transfers while lowering inference time to under one minute in real-world PACS deployment. Ablation studies further confirm the synergistic benefit of multi-task optimization, which narrows the generalization gap and enhances robustness across unseen centers. Taken together, these results highlight the potential of unified multimodal learning to support fast, reliable, and scalable decision-making in acute stroke care.

npj Digital Medicine
Tongji University (CN), Hubei University of Medicine (CN), Aston University (GB), Zunyi Medical University (CN), Jilin University (CN), Chinese Academy of Sciences (CN), Zhejiang Cancer Hospital (CN), First Hospital of Jilin University (CN), Shanghai Pulmonary Hospital (CN), Universities of Giessen and Marburg Lung Center (DE), Shanghai Sixth People's Hospital (CN), Giessen School of Theology (DE), Institute of Natural Science (KP), Huashan Hospital (CN), Affiliated Hospital of Jining Medical University (CN), Shanghai Center for Brain Science and Brain-Inspired Technology (CN)
National Natural Science Foundation of China
Peace, Justice and strong institutions
Openalex Percentile: Top 7%
Acute Ischemic Stroke Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.