CM-HTNet: CNN-Mamba-based Framework for Predicting Hemorrhagic Transformation Risk of AIS Patients using Sequence Relationship Modeling and Multi-Modal Cross Attention

Hemorrhagic transformation (HT) is a severe complication of acute ischemic stroke (AIS) that can lead to disability or death. Accurate and timely risk assessment of HT is essential for clinicians to design effective treatment strategies. Previous studies in HT prediction have largely relied on machine learning and radiomics, which demand extensive manual data preprocessing by physicians. While some HT prediction models based on convolutional neural network (CNN) have been developed, they are limited in their ability to capture the sequential relationships between image slices and often lack the focus on crucial information. This study collected non-contrast computed tomography (NCCT) images and clinical data from 512 AIS patients across six hospitals to create a multi-center dataset. Based on the dataset, we propose CM-HTNet, a novel deep learning framework designed to predict HT risk in AIS patients following intravenous thrombolysis (IVT). CM-HTNet mimics the clinical process of reviewing NCCT images by focusing on key slices and integrating information from adjacent slices. It leverages CNNs to extract features from each NCCT slice and utilizes the Selective State-Space Model (SSM) within the Mamba framework to model sequential relationships between slices while prioritizing features relevant to HT prediction. Additionally, CM-HTNet incorporates the Neighborhood Rough Set (KRS) algorithm for clinical feature selection and cross-attention mechanisms to integrate clinical and imaging data for multimodal HT risk prediction. In testing on an external dataset from independent centers, CM-HTNet achieved a prediction accuracy of 88.85% and an AUC of 95.17%, showcasing its strong performance and generalization capabilities.

Authors

Institutions

Publication Details

Published
2024-12-03
DOI
https://doi.org/10.1109/bibm62325.2024.10822157
Primary Topic
Artificial Intelligence in Healthcare
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CM-HTNet: CNN-Mamba-based Framework for Predicting Hemorrhagic Transformation Risk of AIS Patients using Sequence Relationship Modeling and Multi-Modal Cross Attention

Haodong Xu, Jingfeng Jiang, Jinwang Feng, Yuxiang Huang et al.
Artificial Intelligence in Healthcare
article

CM-HTNet: CNN-Mamba-based Framework for Predicting Hemorrhagic Transformation Risk of AIS Patients using Sequence Relationship Modeling and Multi-Modal Cross Attention

Haodong Xu, Jingfeng Jiang, Jinwang Feng, Yuxiang Huang, Huanhuan Ren, Yongmei Li, Shaoguo Cui
article en

Abstract

Hemorrhagic transformation (HT) is a severe complication of acute ischemic stroke (AIS) that can lead to disability or death. Accurate and timely risk assessment of HT is essential for clinicians to design effective treatment strategies. Previous studies in HT prediction have largely relied on machine learning and radiomics, which demand extensive manual data preprocessing by physicians. While some HT prediction models based on convolutional neural network (CNN) have been developed, they are limited in their ability to capture the sequential relationships between image slices and often lack the focus on crucial information. This study collected non-contrast computed tomography (NCCT) images and clinical data from 512 AIS patients across six hospitals to create a multi-center dataset. Based on the dataset, we propose CM-HTNet, a novel deep learning framework designed to predict HT risk in AIS patients following intravenous thrombolysis (IVT). CM-HTNet mimics the clinical process of reviewing NCCT images by focusing on key slices and integrating information from adjacent slices. It leverages CNNs to extract features from each NCCT slice and utilizes the Selective State-Space Model (SSM) within the Mamba framework to model sequential relationships between slices while prioritizing features relevant to HT prediction. Additionally, CM-HTNet incorporates the Neighborhood Rough Set (KRS) algorithm for clinical feature selection and cross-attention mechanisms to integrate clinical and imaging data for multimodal HT risk prediction. In testing on an external dataset from independent centers, CM-HTNet achieved a prediction accuracy of 88.85% and an AUC of 95.17%, showcasing its strong performance and generalization capabilities.

Michigan Technological University (US), Chongqing Normal University (CN), Chongqing University (CN), The Affiliated Yongchuan Hospital of Chongqing Medical University (CN), Biocom (US), Chongqing Cancer Hospital (CN), Chongqing Medical University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 65%
Artificial Intelligence in Healthcare
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.