CM-HTNet: CNN-Mamba-based Framework for Predicting Hemorrhagic Transformation Risk of AIS Patients using Sequence Relationship Modeling and Multi-Modal Cross Attention
Hemorrhagic transformation (HT) is a severe complication of acute ischemic stroke (AIS) that can lead to disability or death. Accurate and timely risk assessment of HT is essential for clinicians to design effective treatment strategies. Previous studies in HT prediction have largely relied on machine learning and radiomics, which demand extensive manual data preprocessing by physicians. While some HT prediction models based on convolutional neural network (CNN) have been developed, they are limited in their ability to capture the sequential relationships between image slices and often lack the focus on crucial information. This study collected non-contrast computed tomography (NCCT) images and clinical data from 512 AIS patients across six hospitals to create a multi-center dataset. Based on the dataset, we propose CM-HTNet, a novel deep learning framework designed to predict HT risk in AIS patients following intravenous thrombolysis (IVT). CM-HTNet mimics the clinical process of reviewing NCCT images by focusing on key slices and integrating information from adjacent slices. It leverages CNNs to extract features from each NCCT slice and utilizes the Selective State-Space Model (SSM) within the Mamba framework to model sequential relationships between slices while prioritizing features relevant to HT prediction. Additionally, CM-HTNet incorporates the Neighborhood Rough Set (KRS) algorithm for clinical feature selection and cross-attention mechanisms to integrate clinical and imaging data for multimodal HT risk prediction. In testing on an external dataset from independent centers, CM-HTNet achieved a prediction accuracy of 88.85% and an AUC of 95.17%, showcasing its strong performance and generalization capabilities.
Authors
- Haodong Xu (ORCID: https://orcid.org/0000-0003-2086-3893)
- Jingfeng Jiang (ORCID: https://orcid.org/0000-0001-8812-6246)
- Jinwang Feng (ORCID: https://orcid.org/0000-0002-2713-9825)
- Yuxiang Huang (ORCID: https://orcid.org/0000-0003-4581-2443)
- Huanhuan Ren
- Yongmei Li (ORCID: https://orcid.org/0000-0001-5558-9738)
- Shaoguo Cui (ORCID: https://orcid.org/0000-0003-3064-0490)
Institutions
- Michigan Technological University (US)
- Chongqing Normal University (CN)
- Chongqing University (CN)
- The Affiliated Yongchuan Hospital of Chongqing Medical University (CN)
- Biocom (US)
- Chongqing Cancer Hospital (CN)
- Chongqing Medical University (CN)
Publication Details
- Published
- 2024-12-03
- DOI
- https://doi.org/10.1109/bibm62325.2024.10822157
- Primary Topic
- Artificial Intelligence in Healthcare
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China