Enhancement of Underwater Images through Parallel Fusion of Transformer and CNN

Ocean exploration is crucial for utilizing its extensive resources. Images captured by underwater robots suffer from issues such as color distortion and reduced contrast. To address the issue, an innovative enhancement algorithm is proposed, which integrates Transformer and Convolutional Neural Network (CNN) in a parallel fusion manner. Firstly, a novel transformer model is introduced to capture local features, employing peak-signal-to-noise ratio (PSNR) attention and linear operations. Subsequently, to extract global features, both temporal and frequency domain features are incorporated to construct the convolutional neural network. Finally, the image’s high and low frequency information are utilized to fuse different features. To demonstrate the algorithm’s effectiveness, underwater images with various levels of color distortion are selected for both qualitative and quantitative analyses. The experimental results demonstrate that our approach outperforms other mainstream methods, achieving superior PSNR and structural similarity index measure (SSIM) metrics and yielding a detection performance improvement of over ten percent.

Authors

Institutions

Publication Details

Journal
Journal of Marine Science and Engineering
Published
2024-08-23
DOI
https://doi.org/10.3390/jmse12091467
Citations
1
Primary Topic
Image Enhancement Techniques
Type
article
Field-Weighted Citation Impact
0.25

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancement of Underwater Images through Parallel Fusion of Transformer and CNN

Zhixin Chen, Xiangyong Liu, Zhiqiang Xu, Ziwei Zheng et al.
1 citations
Journal of Marine Science and Engineering
Image Enhancement Techniques
0.25
article

Enhancement of Underwater Images through Parallel Fusion of Transformer and CNN

Zhixin Chen, Xiangyong Liu, Zhiqiang Xu, Ziwei Zheng, Yunjie Wang, Fengshuang Ma
article en
1 citations

Abstract

Ocean exploration is crucial for utilizing its extensive resources. Images captured by underwater robots suffer from issues such as color distortion and reduced contrast. To address the issue, an innovative enhancement algorithm is proposed, which integrates Transformer and Convolutional Neural Network (CNN) in a parallel fusion manner. Firstly, a novel transformer model is introduced to capture local features, employing peak-signal-to-noise ratio (PSNR) attention and linear operations. Subsequently, to extract global features, both temporal and frequency domain features are incorporated to construct the convolutional neural network. Finally, the image’s high and low frequency information are utilized to fuse different features. To demonstrate the algorithm’s effectiveness, underwater images with various levels of color distortion are selected for both qualitative and quantitative analyses. The experimental results demonstrate that our approach outperforms other mainstream methods, achieving superior PSNR and structural similarity index measure (SSIM) metrics and yielding a detection performance improvement of over ten percent.

Journal of Marine Science and EngineeringVol. 12(9)
Zhejiang Wanli University (CN), University of Macau (MO), China Fishery Machinery and Instrument Research Institute (CN), City University of Macau (MO)
China Postdoctoral Science Foundation, Basic and Applied Basic Research Foundation of Guangdong Province
Life below water
Openalex Percentile: Top 48%
Image Enhancement Techniques
0.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.