Spatial Invertible Network With Mamba-Convolution for Hyperspectral Image Fusion
Due to the complementary characteristics of hyperspectral image (HSI) and multispectral image (MSI), fusing them can generate a high-resolution hyperspectral image (HR-HSI). However, existing convolutional neural network (CNN)- and Transformer-based methods still suffer from challenges such as spectral distortion, insufficient texture representation, and limited ability to integrate global-local information. To address these issues, we propose a spatial invertible network (SINet) with Mamba-convolution. First, we design the multiscale invertible spatial (MISpa) module to effectively model the spatial information of the source image. The MISpa module utilizes Haar wavelet decomposition to separate high and low-frequency spatial components. By integrating invertible neural network (INN), it enhances the extraction of discriminative spatial features while maintaining structural integrity. To mitigate the risk of excessive reliance on spatial information, which may lead to spectral distortion, we employ spectral compression (via average pooling and 3 × 3 convolution) to extract spectral information at each scale of the source image. Through this way, SINet establishes an effective trade-off between detail enhancement and spectral fidelity. Second, we propose a Mamba convolutional fusion module (MCFM) that integrates feature extraction capabilities of Mamba and CNN. This module is designed to adaptively enhance the complementarity between global and local features, thereby guiding the process of feature enhancement. Experiments on both simulated and real-world datasets from quantitative and qualitative perspectives to validate the superiority of the proposed method compared to existing approaches.
Authors
- Yang Tao (ORCID: https://orcid.org/0000-0002-5058-8899)
- Qiya Song (ORCID: https://orcid.org/0000-0002-3115-0672)
- Xiaohui Wei (ORCID: https://orcid.org/0000-0001-5086-0103)
- Renwei Dian (ORCID: https://orcid.org/0000-0001-9197-6292)
- Feng Mo
- Yuanye Liu (ORCID: https://orcid.org/0009-0008-1128-704X)
- Shuo Guo (ORCID: https://orcid.org/0000-0002-3042-9209)
- Lin Xiao (ORCID: https://orcid.org/0000-0003-0007-2904)
- Yining Yang (ORCID: https://orcid.org/0000-0002-8302-6884)
Institutions
- Hunan University (CN)
- Hunan Normal University (CN)
- Changsha Normal University (CN)
- National Engineering Research Center of Electromagnetic Radiation Control Materials (CN)
Publication Details
- Journal
- IEEE Journal of Selected Topics in Signal Processing
- Published
- 2025-08-11
- DOI
- https://doi.org/10.1109/jstsp.2025.3596518
- Citations
- 3
- Primary Topic
- Advanced Image Fusion Techniques
- Type
- article
- Field-Weighted Citation Impact
- 3.41