Boosting Restoration of Turbulence-Degraded Images With State Space Conditional Diffusion

Recovering fine details from turbulence-distorted images is highly challenging due to the complex, spatially varying, and stochastic nature of the distortion process. Conventional multi-frame methods rely on extracting and averaging clear regions from pre-aligned frames, but their effectiveness is limited due to the rarity of “lucky regions”. In contrast, learning based methods have shown superior performance across various vision tasks. However, existing deep learning approaches still face key limitations: (1) they struggle to efficiently model the global context required for correcting pixel dispersion caused by spatially varying Point Spread Functions (PSFs); (2) they often overlook the physical formation of turbulence, particularly the spatial-frequency relationship between phase distortions and PSFs; and (3) they rely on deterministic architectures that fail to capture the inherent uncertainty in turbulence, leading to visually implausible outputs. To address these issues, we propose the Two-Stage Turbulence Removal Network (TSTRNet). The first stage uses a UNet-based generator built on the State Space Model to perform efficient, coarse global restoration. The second stage refines the output through a Denoising Diffusion Probabilistic Model, introducing stochasticity and edge-guided conditioning for detail enhancement and realism. Both stages incorporate frequency-domain processing to align with the physical characteristics of turbulence. Experimental results on multiple benchmark datasets demonstrate that TSTRNet achieves superior restoration performance compared to state-of-the-art methods, with strong generalization from synthetic to real-world scenarios.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Signal Processing
Published
2025-01-01
DOI
https://doi.org/10.1109/tsp.2025.3580723
Citations
1
Primary Topic
Advanced Image Processing Techniques
Type
article
Field-Weighted Citation Impact
1.28

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Boosting Restoration of Turbulence-Degraded Images With State Space Conditional Diffusion

Yubo Wu, Shuping Zhao, Tingting Chai, Kuanhong Cheng et al.
1 citations
IEEE Transactions on Signal Processing
Advanced Image Processing Techniques
1.28
article

Boosting Restoration of Turbulence-Degraded Images With State Space Conditional Diffusion

Yubo Wu, Shuping Zhao, Tingting Chai, Kuanhong Cheng, Gengyu Lyu, Wei Jia
article en
1 citations

Abstract

Recovering fine details from turbulence-distorted images is highly challenging due to the complex, spatially varying, and stochastic nature of the distortion process. Conventional multi-frame methods rely on extracting and averaging clear regions from pre-aligned frames, but their effectiveness is limited due to the rarity of “lucky regions”. In contrast, learning based methods have shown superior performance across various vision tasks. However, existing deep learning approaches still face key limitations: (1) they struggle to efficiently model the global context required for correcting pixel dispersion caused by spatially varying Point Spread Functions (PSFs); (2) they often overlook the physical formation of turbulence, particularly the spatial-frequency relationship between phase distortions and PSFs; and (3) they rely on deterministic architectures that fail to capture the inherent uncertainty in turbulence, leading to visually implausible outputs. To address these issues, we propose the Two-Stage Turbulence Removal Network (TSTRNet). The first stage uses a UNet-based generator built on the State Space Model to perform efficient, coarse global restoration. The second stage refines the output through a Denoising Diffusion Probabilistic Model, introducing stochasticity and edge-guided conditioning for detail enhancement and realism. Both stages incorporate frequency-domain processing to align with the physical characteristics of turbulence. Experimental results on multiple benchmark datasets demonstrate that TSTRNet achieves superior restoration performance compared to state-of-the-art methods, with strong generalization from synthetic to real-world scenarios.

IEEE Transactions on Signal ProcessingVol. 73
Guangdong University of Technology (CN), Hefei University of Technology (CN), Harbin Institute of Technology (CN), Beijing University of Technology (CN)
National Natural Science Foundation of China, Natural Science Foundation of Shandong Province
Sustainable cities and communities
Openalex Percentile: Top 19%
Advanced Image Processing Techniques
1.28
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.