Fusion-based graph neural networks for synergistic underwater image enhancement

Underwater images have become essential tools for marine exploration. However, their quality is often diminished by specific phenomena inherent to aquatic environments, thereby driving the need for research in Underwater Image Enhancement (UIE). Traditional UIE methods based on Convolutional Neural Networks (CNNs) offer advantages such as effective localized feature extraction but suffer from limited receptive fields that restrict their capability to capture long-range features, resulting in contextual and textural coherence issues. Graph Neural Networks (GNNs) excel in capturing long-range features due to their ability to process relational information across extended spatial contexts. Motivated by this strength, we have developed the Fusion-based Underwater Graph Network (FUGN), which initially segments images into blocks to transform them into a structure amenable to GNN processing. We employ Sobel and Gaussian Blur operators to compute similarities between these blocks, considering both texture and gradient information, which are crucial for constructing robust graph edges. The FUGN architecture synergistically combines the spatial precision of CNNs with the contextual depth of GNNs. This fusion harnesses the strengths of both neural network types, enhancing the overall capability of UIE tasks. Extensive experimental validations demonstrate the effectiveness of FUGN, with improvements of up to 6.49% in FSIM, 5.05% in PSNR, and 9.92% in SSIM, demonstrating marked improvements in the quality and fidelity of enhanced underwater images. Our code is available at https://github.com/zwh233/FUGN . • Challenges with Conventional Approaches : While traditional CNN-based methods effectively extract local features in UIE, their constrained receptive fields limit the handling of comprehensive contextual and textural information. • Graph Neural Networks for Enhanced Range : Graph Neural Networks (GNNs) address these limitations by effectively processing relational information across extended spatial contexts, making them suitable for capturing long-range features in underwater images. • Innovative Fusion-based Approach : The Fusion-based Underwater Graph Network (FUGN) integrates the strengths of CNNs and GNNs, using image segmentation into blocks optimized for GNN processing with Sobel and Gaussian Blur operators to enhance texture and gradient-based similarities. • Proven Effectiveness of FUGN : Extensive experimental validations of FUGN demonstrate significant improvements in the quality and fidelity of enhanced underwater images, confirming the benefits of this synergistic approach in UIE tasks.

Authors

Institutions

Publication Details

Journal
Information Fusion
Published
2024-12-11
DOI
https://doi.org/10.1016/j.inffus.2024.102857
Citations
14
Primary Topic
Image Enhancement Techniques
Type
article
Field-Weighted Citation Impact
3.49

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Fusion-based graph neural networks for synergistic underwater image enhancement

Chengpei Xu, Yan Zhang, Weimin Wang, Zhixiong Huang et al.
14 citations
Information Fusion
Image Enhancement Techniques
3.49
article

Fusion-based graph neural networks for synergistic underwater image enhancement

Chengpei Xu, Yan Zhang, Weimin Wang, Zhixiong Huang, Feng Xia, Yuanfang Zhang, Wenhao Zhou
article en
14 citations

Abstract

Underwater images have become essential tools for marine exploration. However, their quality is often diminished by specific phenomena inherent to aquatic environments, thereby driving the need for research in Underwater Image Enhancement (UIE). Traditional UIE methods based on Convolutional Neural Networks (CNNs) offer advantages such as effective localized feature extraction but suffer from limited receptive fields that restrict their capability to capture long-range features, resulting in contextual and textural coherence issues. Graph Neural Networks (GNNs) excel in capturing long-range features due to their ability to process relational information across extended spatial contexts. Motivated by this strength, we have developed the Fusion-based Underwater Graph Network (FUGN), which initially segments images into blocks to transform them into a structure amenable to GNN processing. We employ Sobel and Gaussian Blur operators to compute similarities between these blocks, considering both texture and gradient information, which are crucial for constructing robust graph edges. The FUGN architecture synergistically combines the spatial precision of CNNs with the contextual depth of GNNs. This fusion harnesses the strengths of both neural network types, enhancing the overall capability of UIE tasks. Extensive experimental validations demonstrate the effectiveness of FUGN, with improvements of up to 6.49% in FSIM, 5.05% in PSNR, and 9.92% in SSIM, demonstrating marked improvements in the quality and fidelity of enhanced underwater images. Our code is available at https://github.com/zwh233/FUGN . • Challenges with Conventional Approaches : While traditional CNN-based methods effectively extract local features in UIE, their constrained receptive fields limit the handling of comprehensive contextual and textural information. • Graph Neural Networks for Enhanced Range : Graph Neural Networks (GNNs) address these limitations by effectively processing relational information across extended spatial contexts, making them suitable for capturing long-range features in underwater images. • Innovative Fusion-based Approach : The Fusion-based Underwater Graph Network (FUGN) integrates the strengths of CNNs and GNNs, using image segmentation into blocks optimized for GNN processing with Sobel and Gaussian Blur operators to enhance texture and gradient-based similarities. • Proven Effectiveness of FUGN : Extensive experimental validations of FUGN demonstrate significant improvements in the quality and fidelity of enhanced underwater images, confirming the benefits of this synergistic approach in UIE tasks.

Information FusionVol. 117
Chongqing University of Posts and Telecommunications (CN), Anhui University (CN), Nanjing University of Information Science and Technology (CN), Dalian University of Technology (CN), Institute of Navigation (US), RMIT University (AU)
RMIT University
Openalex Percentile: Top 6%
Image Enhancement Techniques
3.49
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.