Efficient Multi-Scale Transformer With Convolutional Attention for High-Definition Image Dehazing

Image dehazing aims to recover clear images from hazy inputs, crucial for advanced computer vision tasks. While convolutional neural networks (CNNs) have traditionally been used, transformer-based methods have recently demonstrated superior performance in capturing global information. However, their computational complexity scales quadratically with image resolution, posing challenges for high-resolution tasks. To address these limitations, we propose Mulsormer, a novel transformer-based dehazing model tailored for high-definition images. Mulsormer incorporates Multi-Head Convolutional Attention (MHCA) and a Gated Feed-Forward Network (GFFN) to reduce computational complexity and control critical information flow, respectively. A multi-scale loss function combining perceptual and patch-based losses is utilized to improve detail restoration. Extensive experiments on the SOTS and RTTS datasets show that Mulsormer achieves state-of-the-art performance, with a PSNR of 37.49 dB and an SSIM of 0.993 on the SOTS Indoor dataset, significantly outperforming previous methods. Our approach demonstrates the potential of transformer-based models for efficient high-definition image dehazing. Additionally, our code is publicly available at https://github.com/Wang1666570/Efficient-Multi-Scale-Transformer.

Authors

Institutions

Publication Details

Journal
IEEE Access
Published
2025-01-01
DOI
https://doi.org/10.1109/access.2025.3588390
Citations
2
Primary Topic
Photoacoustic and Ultrasonic Imaging
Type
article
Field-Weighted Citation Impact
1.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Efficient Multi-Scale Transformer With Convolutional Attention for High-Definition Image Dehazing

Zhirui Wang
2 citations
IEEE Access
Photoacoustic and Ultrasonic Imaging
1.35
article

Efficient Multi-Scale Transformer With Convolutional Attention for High-Definition Image Dehazing

Zhirui Wang
article en
2 citations

Abstract

Image dehazing aims to recover clear images from hazy inputs, crucial for advanced computer vision tasks. While convolutional neural networks (CNNs) have traditionally been used, transformer-based methods have recently demonstrated superior performance in capturing global information. However, their computational complexity scales quadratically with image resolution, posing challenges for high-resolution tasks. To address these limitations, we propose Mulsormer, a novel transformer-based dehazing model tailored for high-definition images. Mulsormer incorporates Multi-Head Convolutional Attention (MHCA) and a Gated Feed-Forward Network (GFFN) to reduce computational complexity and control critical information flow, respectively. A multi-scale loss function combining perceptual and patch-based losses is utilized to improve detail restoration. Extensive experiments on the SOTS and RTTS datasets show that Mulsormer achieves state-of-the-art performance, with a PSNR of 37.49 dB and an SSIM of 0.993 on the SOTS Indoor dataset, significantly outperforming previous methods. Our approach demonstrates the potential of transformer-based models for efficient high-definition image dehazing. Additionally, our code is publicly available at https://github.com/Wang1666570/Efficient-Multi-Scale-Transformer.

IEEE AccessVol. 13
Shanxi University (CN), Taiyuan University of Technology (CN)
Affordable and clean energy
Openalex Percentile: Top 19%
Photoacoustic and Ultrasonic Imaging
1.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.