A Lightweight Hybrid CNN-Mamba Network for Hyperspectral Image Classification

In hyperspectral image (HSI) classification, the effectiveness and efficiency of modeling complex spectral-spatial relationships are critical. However, most of CNN and Transformer-based methods face challenges in modeling local and global spectral-spatial information while demanding high computational resources. To address these issues, we propose a lightweight hybrid CNN-Mamba network for hyperspectral image classification (HSIC), which combines the strengths of CNN and Mamba models, and effectively captures both global and local spectral-spatial features. First, we introduce a wavelet separable convolution (WSC) module to enhance spatial feature extraction. The WSC module integrates wavelet transform with depth-wise separable convolution, expanding the receptive field and improving the model's ability to capture complex spatial structures while maintaining computational efficiency. Second, we propose a lightweight spectral convolution (LSC) module, which focuses on extracting local spectral features through 3-D convolution, balancing accuracy and computational burden. Additionally, the network incorporates the Mamba module for modeling long-range dependencies via a state-space model (SSM). The experimental results show that the classification performance of our method on Pavia University datasets outstands several state-of-the-art methods.

Authors

Institutions

Publication Details

Published
2024-12-20
DOI
https://doi.org/10.1145/3718441.3718452
Primary Topic
Remote-Sensing Image Classification
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Lightweight Hybrid CNN-Mamba Network for Hyperspectral Image Classification

Xiang Xu, Huarun Zhang
Remote-Sensing Image Classification
article

A Lightweight Hybrid CNN-Mamba Network for Hyperspectral Image Classification

Xiang Xu, Huarun Zhang
article en

Abstract

In hyperspectral image (HSI) classification, the effectiveness and efficiency of modeling complex spectral-spatial relationships are critical. However, most of CNN and Transformer-based methods face challenges in modeling local and global spectral-spatial information while demanding high computational resources. To address these issues, we propose a lightweight hybrid CNN-Mamba network for hyperspectral image classification (HSIC), which combines the strengths of CNN and Mamba models, and effectively captures both global and local spectral-spatial features. First, we introduce a wavelet separable convolution (WSC) module to enhance spatial feature extraction. The WSC module integrates wavelet transform with depth-wise separable convolution, expanding the receptive field and improving the model's ability to capture complex spatial structures while maintaining computational efficiency. Second, we propose a lightweight spectral convolution (LSC) module, which focuses on extracting local spectral features through 3-D convolution, balancing accuracy and computational burden. Additionally, the network incorporates the Mamba module for modeling long-range dependencies via a state-space model (SSM). The experimental results show that the classification performance of our method on Pavia University datasets outstands several state-of-the-art methods.

University of Electronic Science and Technology of China (CN)
Openalex Percentile: Top 57%
Remote-Sensing Image Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.