Spatial Invertible Network With Mamba-Convolution for Hyperspectral Image Fusion

Due to the complementary characteristics of hyperspectral image (HSI) and multispectral image (MSI), fusing them can generate a high-resolution hyperspectral image (HR-HSI). However, existing convolutional neural network (CNN)- and Transformer-based methods still suffer from challenges such as spectral distortion, insufficient texture representation, and limited ability to integrate global-local information. To address these issues, we propose a spatial invertible network (SINet) with Mamba-convolution. First, we design the multiscale invertible spatial (MISpa) module to effectively model the spatial information of the source image. The MISpa module utilizes Haar wavelet decomposition to separate high and low-frequency spatial components. By integrating invertible neural network (INN), it enhances the extraction of discriminative spatial features while maintaining structural integrity. To mitigate the risk of excessive reliance on spatial information, which may lead to spectral distortion, we employ spectral compression (via average pooling and 3 × 3 convolution) to extract spectral information at each scale of the source image. Through this way, SINet establishes an effective trade-off between detail enhancement and spectral fidelity. Second, we propose a Mamba convolutional fusion module (MCFM) that integrates feature extraction capabilities of Mamba and CNN. This module is designed to adaptively enhance the complementarity between global and local features, thereby guiding the process of feature enhancement. Experiments on both simulated and real-world datasets from quantitative and qualitative perspectives to validate the superiority of the proposed method compared to existing approaches.

Authors

Institutions

Publication Details

Journal
IEEE Journal of Selected Topics in Signal Processing
Published
2025-08-11
DOI
https://doi.org/10.1109/jstsp.2025.3596518
Citations
3
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
3.41
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Spatial Invertible Network With Mamba-Convolution for Hyperspectral Image Fusion

Yang Tao, Qiya Song, Xiaohui Wei, Renwei Dian et al.
3 citations
IEEE Journal of Selected Topics in Signal Processing
Advanced Image Fusion Techniques
3.41
article

Spatial Invertible Network With Mamba-Convolution for Hyperspectral Image Fusion

Yang Tao, Qiya Song, Xiaohui Wei, Renwei Dian, Feng Mo, Yuanye Liu, Shuo Guo, Lin Xiao, Yining Yang
article en
3 citations

Abstract

Due to the complementary characteristics of hyperspectral image (HSI) and multispectral image (MSI), fusing them can generate a high-resolution hyperspectral image (HR-HSI). However, existing convolutional neural network (CNN)- and Transformer-based methods still suffer from challenges such as spectral distortion, insufficient texture representation, and limited ability to integrate global-local information. To address these issues, we propose a spatial invertible network (SINet) with Mamba-convolution. First, we design the multiscale invertible spatial (MISpa) module to effectively model the spatial information of the source image. The MISpa module utilizes Haar wavelet decomposition to separate high and low-frequency spatial components. By integrating invertible neural network (INN), it enhances the extraction of discriminative spatial features while maintaining structural integrity. To mitigate the risk of excessive reliance on spatial information, which may lead to spectral distortion, we employ spectral compression (via average pooling and 3 × 3 convolution) to extract spectral information at each scale of the source image. Through this way, SINet establishes an effective trade-off between detail enhancement and spectral fidelity. Second, we propose a Mamba convolutional fusion module (MCFM) that integrates feature extraction capabilities of Mamba and CNN. This module is designed to adaptively enhance the complementarity between global and local features, thereby guiding the process of feature enhancement. Experiments on both simulated and real-world datasets from quantitative and qualitative perspectives to validate the superiority of the proposed method compared to existing approaches.

IEEE Journal of Selected Topics in Signal ProcessingVol. 19(8)
Hunan University (CN), Hunan Normal University (CN), Changsha Normal University (CN), National Engineering Research Center of Electromagnetic Radiation Control Materials (CN)
Openalex Percentile: Top 7%
Advanced Image Fusion Techniques
3.41
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.