Visual State Space Model for Image Super-Resolution
Transformers and convolutional neural networks (CNNs) have garnered significant attention recently for low-level vision tasks, particularly image super-resolution (SR). However, CNNs are constrained by their local feature extraction capabilities, while Transformers suffer from the quadratic complexity of attention computation. To address these challenges effectively, we propose the dense-residual-connected mamba (DRCM) for SR. The DRCM overcomes the limitations of CNN and provides new advanced modeling capabilities akin to those of Transformers by utilizing global receptive fields and dynamic weighting mechanisms. We have integrated the Mamba with dense-residual connections to create a new dense-residual state-space block (DRSSB), which enhances local detail recovery and further reduces channel redundancy. DRCM effectively captures long-range dependencies, enhancing local detail recovery and significantly reducing channel redundancy. Such structure improves both the model’s efficiency and effectiveness. Experimental results demonstrate that the DRCM significantly improves the quality of reconstructed images while maintaining linear computational complexity, thereby achieving state-of-the-art performance on multiple benchmark datasets.
Authors
- Dan Fang
- Chaowang Li
- Wenzhao Li
- Jinhang Zhang
- M. Gao (ORCID: https://orcid.org/0009-0008-2580-6373)
Institutions
- PLA Army Engineering University (CN)
Publication Details
- Journal
- IEEE Transactions on Instrumentation and Measurement
- Published
- 2024-12-26
- DOI
- https://doi.org/10.1109/tim.2024.3522426
- Citations
- 3
- Primary Topic
- Advanced Image Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.75