Transformer-based Diffusion Model for Single Image Deblurring

A Transformer-based diffusion model for single image deblurring is proposed in this paper, which combines diffusion model and transformer block. Specifically, the blurred image is first used as a condition to guide the diffusion model to reverse restore and generate deblurred clean background image. Secondly, a U-shape Spatially Gate Transformer Net for Noise Estimation(USGTN-NE) is proposed, which utilizes blurred image and noisy states to estimate the distribution of noise. Introducing Spatially Adaptive Feature Modulation(SAFM) into the network to capture multi-scale and global information, combined with gate mechanisms to enhance the network's noise prediction capability. The experimental results show that the PSNR index and SSIM index of our proposal are higher than those of other competitors. The subjective quality has also been improved, and the restored images are visually closer to the real situation.

Authors

Institutions

Publication Details

Published
2024-11-01
DOI
https://doi.org/10.1109/cac63892.2024.10864714
Primary Topic
Advanced Image Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Transformer-based Diffusion Model for Single Image Deblurring

Zongyu Ye, Min Yang, Liying Yang
Advanced Image Processing Techniques
article

Transformer-based Diffusion Model for Single Image Deblurring

Zongyu Ye, Min Yang, Liying Yang
article en

Abstract

A Transformer-based diffusion model for single image deblurring is proposed in this paper, which combines diffusion model and transformer block. Specifically, the blurred image is first used as a condition to guide the diffusion model to reverse restore and generate deblurred clean background image. Secondly, a U-shape Spatially Gate Transformer Net for Noise Estimation(USGTN-NE) is proposed, which utilizes blurred image and noisy states to estimate the distribution of noise. Introducing Spatially Adaptive Feature Modulation(SAFM) into the network to capture multi-scale and global information, combined with gate mechanisms to enhance the network's noise prediction capability. The experimental results show that the PSNR index and SSIM index of our proposal are higher than those of other competitors. The subjective quality has also been improved, and the restored images are visually closer to the real situation.

Nanjing University of Posts and Telecommunications (CN)
Openalex Percentile: Top 73%
Advanced Image Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.