Towards marine snow removal with fusing Fourier information

Marine snow, caused by the aggregation of small organic and inorganic particles, creates a visual effect similar to drifting snowflakes. Traditional methods for removing marine snow often use median filtering, which can blur the entire image. Although deep learning approaches attempt to address this issue, they typically only work in the spatial domain and still struggle with blurring and residual marine snow artifacts. These challenges arise because the spatial domain alone cannot easily distinguish between real object structures and noise-like marine snow artifacts. To address this, we propose the Deep Fourier Marine Snow Removal Network (DF-MSRN), which integrates both spatial and Fourier domain information to effectively restore images affected by marine snow. DF-MSRN employs a two-stage approach that leverages both Fourier frequency and spatial information: it first estimates a restored map of the amplitude component to address particle removal, avoiding additional noise in the spatial domain. Then, a fusion module combines Fourier frequency global information with spatial local information to refine image details. Experimental results show that DF-MSRN significantly outperforms existing denoising techniques on various marine image datasets, enhancing image clarity and detail preservation. • Proposed Fourier-based method utilizing unique Fourier traits for marine snow removal. • Developed a two-stage pipeline combining Fourier and spatial info for better removal. • Validated with extensive experiments, ablation studies, and benchmark comparisons.

Authors

Institutions

Publication Details

Journal
Information Fusion
Published
2024-11-26
DOI
https://doi.org/10.1016/j.inffus.2024.102810
Citations
23
Primary Topic
Cryospheric studies and observations
Type
article
Field-Weighted Citation Impact
8.65

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Towards marine snow removal with fusing Fourier information

Jun Xiao, Junyu Dong, Huiyu Zhou, Anwei Luo et al.
23 citations
Information Fusion
Cryospheric studies and observations
8.65
article

Towards marine snow removal with fusing Fourier information

Jun Xiao, Junyu Dong, Huiyu Zhou, Anwei Luo, Alex C. Kot, Yakun Ju, Cong Zhang, Hao Xie
article en
23 citations

Abstract

Marine snow, caused by the aggregation of small organic and inorganic particles, creates a visual effect similar to drifting snowflakes. Traditional methods for removing marine snow often use median filtering, which can blur the entire image. Although deep learning approaches attempt to address this issue, they typically only work in the spatial domain and still struggle with blurring and residual marine snow artifacts. These challenges arise because the spatial domain alone cannot easily distinguish between real object structures and noise-like marine snow artifacts. To address this, we propose the Deep Fourier Marine Snow Removal Network (DF-MSRN), which integrates both spatial and Fourier domain information to effectively restore images affected by marine snow. DF-MSRN employs a two-stage approach that leverages both Fourier frequency and spatial information: it first estimates a restored map of the amplitude component to address particle removal, avoiding additional noise in the spatial domain. Then, a fusion module combines Fourier frequency global information with spatial local information to refine image details. Experimental results show that DF-MSRN significantly outperforms existing denoising techniques on various marine image datasets, enhancing image clarity and detail preservation. • Proposed Fourier-based method utilizing unique Fourier traits for marine snow removal. • Developed a two-stage pipeline combining Fourier and spatial info for better removal. • Validated with extensive experiments, ablation studies, and benchmark comparisons.

Information FusionVol. 117
Hong Kong Polytechnic University (HK), University of Leicester (GB), Sun Yat-sen University (CN), Nanyang Technological University (SG), Ocean University of China (CN)
National Key Scientific Instrument and Equipment Development Projects of China, National Key Research and Development Program of China
Openalex Percentile: Top 1%
Cryospheric studies and observations
8.65
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.