MCAMamba: Multilevel Cross-Modal Attention-Guided State-Space Model for Multisource Remote Sensing Image Classification

Effective fusion of multi-source remote sensing data remains a fundamental challenge for Earth observation, as CNN and Transformer models suffer from limited receptive fields and high computational complexity. While State Space Models (SSM) like Mamba show promise in sequence modeling, they face three critical challenges in multi-source remote sensing: insufficient spatial-spectral coordination, cross-modal heterogeneity, and inadequate multi-scale feature integration. To address these limitations, this paper proposes MCAMamba: a Multi-Level Cross-Modal Attention-Guided Mamba framework for joint classification of hyperspectral images (HSI) and Light Detection and Ranging (LiDAR)/Synthetic Aperture Radar (SAR) data. MCAMamba introduces a novel three-stage feature fusion pipeline: 1) The FExt-Attention module enhances spatial structure and spectral information through parallel spatial-channel attention mechanisms. 2) The SSM-Attention module achieves deep cross-modal fusion by combining attention mechanisms with SSM for parametric interaction. 3) The FFus-Attention module performs adaptive multi-scale feature integration through global context modeling and cascaded attention. This hierarchical design enables superior feature representation with enhanced computational efficiency. Experiments on four public benchmark datasets (Houston2013, Houston2018, Augsburg, and Berlin) show that MCAMamba achieves Overall Accuracy (OA) of 94.75%, 93.35%, 92.46%, and 79.18%. The code will be available at https://github.com/Dmygithub/MCAMamba.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Geoscience and Remote Sensing
Published
2025-01-01
DOI
https://doi.org/10.1109/tgrs.2025.3618301
Citations
1
Primary Topic
Remote-Sensing Image Classification
Type
article
Field-Weighted Citation Impact
1.14
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

MCAMamba: Multilevel Cross-Modal Attention-Guided State-Space Model for Multisource Remote Sensing Image Classification

Ming Hu, Xiaozhen Qiao, Zhe Sun, Huping Ye et al.
1 citations
IEEE Transactions on Geoscience and Remote Sensing
Remote-Sensing Image Classification
1.14
article

MCAMamba: Multilevel Cross-Modal Attention-Guided State-Space Model for Multisource Remote Sensing Image Classification

Ming Hu, Xiaozhen Qiao, Zhe Sun, Huping Ye, Xiaohan Liao, Shi Qiu, Mingyu Dou
article en
1 citations

Abstract

Effective fusion of multi-source remote sensing data remains a fundamental challenge for Earth observation, as CNN and Transformer models suffer from limited receptive fields and high computational complexity. While State Space Models (SSM) like Mamba show promise in sequence modeling, they face three critical challenges in multi-source remote sensing: insufficient spatial-spectral coordination, cross-modal heterogeneity, and inadequate multi-scale feature integration. To address these limitations, this paper proposes MCAMamba: a Multi-Level Cross-Modal Attention-Guided Mamba framework for joint classification of hyperspectral images (HSI) and Light Detection and Ranging (LiDAR)/Synthetic Aperture Radar (SAR) data. MCAMamba introduces a novel three-stage feature fusion pipeline: 1) The FExt-Attention module enhances spatial structure and spectral information through parallel spatial-channel attention mechanisms. 2) The SSM-Attention module achieves deep cross-modal fusion by combining attention mechanisms with SSM for parametric interaction. 3) The FFus-Attention module performs adaptive multi-scale feature integration through global context modeling and cascaded attention. This hierarchical design enables superior feature representation with enhanced computational efficiency. Experiments on four public benchmark datasets (Houston2013, Houston2018, Augsburg, and Berlin) show that MCAMamba achieves Overall Accuracy (OA) of 94.75%, 93.35%, 92.46%, and 79.18%. The code will be available at https://github.com/Dmygithub/MCAMamba.

IEEE Transactions on Geoscience and Remote SensingVol. 63
University of Science and Technology of China (CN), Civil Aviation Administration of China (CN), Northwestern Polytechnical University (CN), Chinese Academy of Sciences (CN), Xi'an Institute of Optics and Precision Mechanics (CN), Institute of Geographic Sciences and Natural Resources Research (CN)
Openalex Percentile: Top 15%
Remote-Sensing Image Classification
1.14
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.