Adaptive Depth Enhancement Network for RGB-D Salient Object Detection

RGB-D Salient Object Detection (SOD) aims to identify and highlight the most visually prominent objects from complex backgrounds by leveraging both RGB and depth information. However, depth maps often suffer from noise and inconsistencies due to the imaging modalities and sensor limitations. Additionally, the low-level spatial details and high-level semantic information from multiple levels pose another complexity layer. These issues result in depth maps that may not align well with the corresponding RGB images, causing incorrect foreground and background segmentation. To address these issues, we propose a novel adaptive depth enhancement network (ADENet), which adopts the Depth Feature Refinement (DFR) module to mitigate the negative impact of low-quality depth data and improve the synergy between multi-modal features. We also design a simple yet effective Cross Modality Fusion (CMF) module that combines the spatial and channel attention mechanisms to calibrate single modality features and boost the fusion. The Progressive Multiscale Aggregation (PMA) decoder has also been introduced to integrate multiscale features, promoting more globally retained information. Extensive experiments illustrate that our proposed ADENet is superior to the other 10 state-of-the-art methods on four benchmark datasets.

Authors

Institutions

Publication Details

Journal
IEEE Signal Processing Letters
Published
2024-11-26
DOI
https://doi.org/10.1109/lsp.2024.3506863
Citations
2
Primary Topic
Visual Attention and Saliency Detection
Type
article
Field-Weighted Citation Impact
0.50
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Adaptive Depth Enhancement Network for RGB-D Salient Object Detection

Kang Yi, Jing Xu, Yumeng Li, Haoran Tang
2 citations
IEEE Signal Processing Letters
Visual Attention and Saliency Detection
0.50
article

Adaptive Depth Enhancement Network for RGB-D Salient Object Detection

Kang Yi, Jing Xu, Yumeng Li, Haoran Tang
article en
2 citations

Abstract

RGB-D Salient Object Detection (SOD) aims to identify and highlight the most visually prominent objects from complex backgrounds by leveraging both RGB and depth information. However, depth maps often suffer from noise and inconsistencies due to the imaging modalities and sensor limitations. Additionally, the low-level spatial details and high-level semantic information from multiple levels pose another complexity layer. These issues result in depth maps that may not align well with the corresponding RGB images, causing incorrect foreground and background segmentation. To address these issues, we propose a novel adaptive depth enhancement network (ADENet), which adopts the Depth Feature Refinement (DFR) module to mitigate the negative impact of low-quality depth data and improve the synergy between multi-modal features. We also design a simple yet effective Cross Modality Fusion (CMF) module that combines the spatial and channel attention mechanisms to calibrate single modality features and boost the fusion. The Progressive Multiscale Aggregation (PMA) decoder has also been introduced to integrate multiscale features, promoting more globally retained information. Extensive experiments illustrate that our proposed ADENet is superior to the other 10 state-of-the-art methods on four benchmark datasets.

IEEE Signal Processing LettersVol. 32
Hong Kong Polytechnic University (HK), Nankai University (CN)
Climate action
Openalex Percentile: Top 33%
Visual Attention and Saliency Detection
0.50
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Adaptive Depth Enhancement Network for RGB-D Salient Object Detection — Kang Yi, Jing Xu, et al. · IEEE Signal Processing Letters (2024) | TGRS Research Map | TGRS