Mamba-Driven Multiscale Spatial-Spectral Fusion Network for Few-Shot Hyperspectral Image Classification
The core of hyperspectral image (HSI) classification lies in the effective fusion of spatial-spectral features. However, traditional methods are limited by the capacity of handcrafted feature representation, while deep learning methods face challenges such as overfitting with small sample sizes and high computational complexity. This paper proposes a Mamba-driven multi-scale spatial-spectral fusion network (M<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup>S<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup>F-Net). This network extracts spatial-spectral features at different granularities through the Spatial-Spectral Multi-Granularity Feature Extraction Module (SSMG-FEM), adaptively enhances the spatial-spectral correlation through the Spatial-Spectral Fusion Attention Module (SSFAM), optimizes feature fusion by combining local and global streams with the Feature Fusion Enhanced Vision Transformer (FFEVT), and establishes long- sequence dependencies using the Dual-Path Feature Fusion Mamba (DPFFM). The M<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup>S<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup>F-Net employs a multi-stage feature fusion strategy of “ coarse fusion-fine optimization-strong screening ” to achieve efficient classification with few samples. The network was validated on three publicly available HSI datasets to demonstrate its superiority in few-shot scenarios, with significant improvements in classification accuracy. It also exhibited remarkable classification performance across different numbers of training samples.
Authors
- Zhihui Wang (ORCID: https://orcid.org/0000-0001-8140-1882)
- Jun Liu (ORCID: https://orcid.org/0000-0002-7280-1443)
- Huali Li (ORCID: https://orcid.org/0000-0003-2210-2780)
- Huihui Ding (ORCID: https://orcid.org/0009-0003-1680-4687)
- Yingying Peng (ORCID: https://orcid.org/0009-0007-2462-4204)
Institutions
- Hunan University of Traditional Chinese Medicine (CN)
- Centre for Artificial Intelligence and Robotics (IN)
Publication Details
- Journal
- IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/jstars.2025.3596032
- Citations
- 2
- Primary Topic
- Remote-Sensing Image Classification
- Type
- article
- Field-Weighted Citation Impact
- 2.27
Funders
- National Natural Science Foundation of China