ACMamba: A State Space Model-Based Approach for Multi-Weather Degraded Image Restoration

In computer vision, eliminating the effects of adverse weather conditions such as rain, snow, and fog on images is a key research challenge. Existing studies primarily focus on image restoration for single weather types, while methods addressing image restoration under multiple combined weather conditions remain relatively scarce. Furthermore, current mainstream restoration networks, mostly based on Transformer and CNN architectures, struggle to achieve an effective balance between global receptive field and computational efficiency, limiting their performance in practical applications. This study proposes ACMamba, an end-to-end lightweight network based on selective state space models, aimed at achieving image restoration under multiple weather conditions using a unified set of parameters. Specifically, we design a novel Visual State Space Module (VSSM) and a Spatially Aware Feed-Forward Network (SAFN), which organically combine the local feature extraction capabilities of convolutions with the long-range dependency modeling capabilities of selective state space models (SSMs). This combination significantly improves computational efficiency while maintaining a global receptive field, enabling effective application of the Mamba architecture to multi-weather image restoration tasks. Comprehensive experiments demonstrate that our proposed approach significantly outperforms existing methods for both specific and multi-weather tasks across multiple benchmark datasets, showcasing its efficient long-range modeling potential in multi-weather image restoration tasks.

Authors

Institutions

Publication Details

Journal
Electronics
Published
2024-10-31
DOI
https://doi.org/10.3390/electronics13214294
Citations
1
Primary Topic
Image and Signal Denoising Methods
Type
article
Field-Weighted Citation Impact
0.25
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ACMamba: A State Space Model-Based Approach for Multi-Weather Degraded Image Restoration

Zhao Pei, Yunpeng Ju, Weimin Lei, Wei Wang
1 citations
Electronics
Image and Signal Denoising Methods
0.25
article

ACMamba: A State Space Model-Based Approach for Multi-Weather Degraded Image Restoration

Zhao Pei, Yunpeng Ju, Weimin Lei, Wei Wang
article en
1 citations

Abstract

In computer vision, eliminating the effects of adverse weather conditions such as rain, snow, and fog on images is a key research challenge. Existing studies primarily focus on image restoration for single weather types, while methods addressing image restoration under multiple combined weather conditions remain relatively scarce. Furthermore, current mainstream restoration networks, mostly based on Transformer and CNN architectures, struggle to achieve an effective balance between global receptive field and computational efficiency, limiting their performance in practical applications. This study proposes ACMamba, an end-to-end lightweight network based on selective state space models, aimed at achieving image restoration under multiple weather conditions using a unified set of parameters. Specifically, we design a novel Visual State Space Module (VSSM) and a Spatially Aware Feed-Forward Network (SAFN), which organically combine the local feature extraction capabilities of convolutions with the long-range dependency modeling capabilities of selective state space models (SSMs). This combination significantly improves computational efficiency while maintaining a global receptive field, enabling effective application of the Mamba architecture to multi-weather image restoration tasks. Comprehensive experiments demonstrate that our proposed approach significantly outperforms existing methods for both specific and multi-weather tasks across multiple benchmark datasets, showcasing its efficient long-range modeling potential in multi-weather image restoration tasks.

ElectronicsVol. 13(21)
Chinese Academy of Sciences (CN), Shenyang Institute of Computing Technology (China) (CN), University of Chinese Academy of Sciences (CN), Northeastern University (CN)
Sustainable cities and communities
Openalex Percentile: Top 45%
Image and Signal Denoising Methods
0.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.