FLAME: Flow Guidance and Adaptive Frequency Fusion for All-in-One Mamba-Enhanced Video Restoration

All-in-One video restoration under adverse weather conditions (e.g., rain, snow, haze) remains challenging, as existing methods either rely on explicit optical flow alignment that becomes unreliable under heavy degradations, or employ implicit sequence modeling that lacks fine-grained temporal correspondence. We propose FLAME, a unified FLow guidance and Adaptive frequency fusion for all-in-one Mamba-Enhanced video restoration framework that synergistically combines explicit alignment with implicit modeling through three core components: (i) Dual-Path Mamba Modeling with complementary Space-Time Sequence Mamba and Hilbert-Sequence Mamba blocks for efficient spatiotemporal modeling with linear-complexity Mamba scanning; (ii) Flow-guided Lightweight Attention featuring degradation-aware flow estimation with triple quality assessment and temporal-spatial attention deformable fusion; (iii) Adaptive Frequency Residual Fusion employing learnable frequency decomposition and cross-channel attention for degradation-specific spectral enhancement. Comprehensive experiments demonstrate state-of-the-art performance: 35.50 dB PSNR on VRDS (+3.46 dB over RainMamba), 40.17 dB on LWDDS (+2.96 dB over RainMamba), 31.04 dB on W3 multiweather benchmark (+0.59 dB over AIM-VR), and 29.00 dB on RainSynAll100 rain-haze mixture (+1.33 dB over BasicVSR++), validating the effectiveness of explicit-implicit synergy for diverse weather degradation restoration.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Image Processing
Published
2026-11-18
DOI
https://doi.org/10.1109/tip.2026.3748353
Primary Topic
Advanced Image Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

FLAME: Flow Guidance and Adaptive Frequency Fusion for All-in-One Mamba-Enhanced Video Restoration

Wenhan Luo, Junjie Huang, Meng Wang, Xinwang Liu et al.
IEEE Transactions on Image Processing
Advanced Image Processing Techniques
article

FLAME: Flow Guidance and Adaptive Frequency Fusion for All-in-One Mamba-Enhanced Video Restoration

Wenhan Luo, Junjie Huang, Meng Wang, Xinwang Liu, Tianrui Liu, Wentao Zhao, Zhizhou Lu
article en

Abstract

All-in-One video restoration under adverse weather conditions (e.g., rain, snow, haze) remains challenging, as existing methods either rely on explicit optical flow alignment that becomes unreliable under heavy degradations, or employ implicit sequence modeling that lacks fine-grained temporal correspondence. We propose FLAME, a unified FLow guidance and Adaptive frequency fusion for all-in-one Mamba-Enhanced video restoration framework that synergistically combines explicit alignment with implicit modeling through three core components: (i) Dual-Path Mamba Modeling with complementary Space-Time Sequence Mamba and Hilbert-Sequence Mamba blocks for efficient spatiotemporal modeling with linear-complexity Mamba scanning; (ii) Flow-guided Lightweight Attention featuring degradation-aware flow estimation with triple quality assessment and temporal-spatial attention deformable fusion; (iii) Adaptive Frequency Residual Fusion employing learnable frequency decomposition and cross-channel attention for degradation-specific spectral enhancement. Comprehensive experiments demonstrate state-of-the-art performance: 35.50 dB PSNR on VRDS (+3.46 dB over RainMamba), 40.17 dB on LWDDS (+2.96 dB over RainMamba), 31.04 dB on W3 multiweather benchmark (+0.59 dB over AIM-VR), and 29.00 dB on RainSynAll100 rain-haze mixture (+1.33 dB over BasicVSR++), validating the effectiveness of explicit-implicit synergy for diverse weather degradation restoration.

IEEE Transactions on Image ProcessingVol. PP
Hefei University of Technology (CN), National University of Defense Technology (CN), Hong Kong University of Science and Technology (HK)
Advanced Image Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon