IRSRMamba: Infrared Image Super-Resolution via Mamba-Based Wavelet Transform Feature Modulation Model
Infrared image super-resolution (IRSR) is challenging due to weak structures and textures. While Mamba-based state-space models (SSMs) efficiently model long-range dependencies, their inherent block-wise processing disrupts spatial consistency, limiting direct IRSR applicability. We propose IRSRMamba, a novel Mamba-based framework overcoming this limitation via tailored structural and textural preservation. Integrated into a Mamba backbone, our key innovations are: 1) Wavelet Transform Feature Modulation (WTFM), enhancing multi-scale frequency-aware feature extraction to mitigate block-induced coherence loss; and 2) an SSMs-based Semantic Consistency Loss, enforcing cross-block alignment to restore fragmented context. IRSRMamba achieves superior global-local fusion, structural coherence, and fine-detail preservation. Experiments show state-of-the-art PSNR, SSIM, and perceptual quality on IR benchmarks, as well as robust generalization to remote sensing. This work establishes Mamba-based architectures as highly promising for high-fidelity IR image enhancement. Code is available at https://github.com/yongsongH/IRSRMamba.
Authors
- Tomo Miyazaki (ORCID: https://orcid.org/0000-0001-5205-0542)
- Shinichiro Omachi (ORCID: https://orcid.org/0000-0001-7706-9995)
- Xiaofeng Liu (ORCID: https://orcid.org/0000-0002-4514-2016)
- Yongsong Huang (ORCID: https://orcid.org/0000-0003-3114-9206)
Institutions
- Tohoku University (JP)
- Yale University (US)
Publication Details
- Journal
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tgrs.2025.3584385
- Citations
- 17
- Primary Topic
- Advanced Image Fusion Techniques
- Type
- article
- Field-Weighted Citation Impact
- 19.30
Funders
- Japan Society for the Promotion of Science