Visual State Space Model for Image Super-Resolution

Transformers and convolutional neural networks (CNNs) have garnered significant attention recently for low-level vision tasks, particularly image super-resolution (SR). However, CNNs are constrained by their local feature extraction capabilities, while Transformers suffer from the quadratic complexity of attention computation. To address these challenges effectively, we propose the dense-residual-connected mamba (DRCM) for SR. The DRCM overcomes the limitations of CNN and provides new advanced modeling capabilities akin to those of Transformers by utilizing global receptive fields and dynamic weighting mechanisms. We have integrated the Mamba with dense-residual connections to create a new dense-residual state-space block (DRSSB), which enhances local detail recovery and further reduces channel redundancy. DRCM effectively captures long-range dependencies, enhancing local detail recovery and significantly reducing channel redundancy. Such structure improves both the model’s efficiency and effectiveness. Experimental results demonstrate that the DRCM significantly improves the quality of reconstructed images while maintaining linear computational complexity, thereby achieving state-of-the-art performance on multiple benchmark datasets.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Instrumentation and Measurement
Published
2024-12-26
DOI
https://doi.org/10.1109/tim.2024.3522426
Citations
3
Primary Topic
Advanced Image Processing Techniques
Type
article
Field-Weighted Citation Impact
0.75
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Visual State Space Model for Image Super-Resolution

Dan Fang, Chaowang Li, Wenzhao Li, Jinhang Zhang et al.
3 citations
IEEE Transactions on Instrumentation and Measurement
Advanced Image Processing Techniques
0.75
article

Visual State Space Model for Image Super-Resolution

Dan Fang, Chaowang Li, Wenzhao Li, Jinhang Zhang, M. Gao
article en
3 citations

Abstract

Transformers and convolutional neural networks (CNNs) have garnered significant attention recently for low-level vision tasks, particularly image super-resolution (SR). However, CNNs are constrained by their local feature extraction capabilities, while Transformers suffer from the quadratic complexity of attention computation. To address these challenges effectively, we propose the dense-residual-connected mamba (DRCM) for SR. The DRCM overcomes the limitations of CNN and provides new advanced modeling capabilities akin to those of Transformers by utilizing global receptive fields and dynamic weighting mechanisms. We have integrated the Mamba with dense-residual connections to create a new dense-residual state-space block (DRSSB), which enhances local detail recovery and further reduces channel redundancy. DRCM effectively captures long-range dependencies, enhancing local detail recovery and significantly reducing channel redundancy. Such structure improves both the model’s efficiency and effectiveness. Experimental results demonstrate that the DRCM significantly improves the quality of reconstructed images while maintaining linear computational complexity, thereby achieving state-of-the-art performance on multiple benchmark datasets.

IEEE Transactions on Instrumentation and MeasurementVol. 74
PLA Army Engineering University (CN)
Sustainable cities and communities
Openalex Percentile: Top 26%
Advanced Image Processing Techniques
0.75
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.