Dual-Stream Bilateral Feature Fusion Network for RGB-D Salient Object Detection

To address the challenges associated with unstable depth map quality in RGB-D salient object detection, this paper introduces a dual-stream network (DSN) architecture that independently processes RGB and depth image inputs while merging these modalities using a multi-scale fusion strategy. Depth maps, however, are often affected by noise and incomplete regions due to sensor limitations, resulting in quality fluctuations that hinder effective multi-modal feature fusion. To mitigate this issue, we incorporate gated convolution into the depth stream, enabling dynamic adjustment of the feature extraction process based on depth map quality. This approach effectively suppresses low-quality depth information, facilitating the efficient integration of depth and RGB features. Consequently, the network can extract valuable geometric information from low-quality depth maps, maintaining high detection accuracy in complex scenes. Extensive experiments on multiple public datasets show that the proposed method significantly enhances performance in salient object detection tasks.

Authors

Institutions

Publication Details

Published
2024-10-11
DOI
https://doi.org/10.1109/cbase64041.2024.10824343
Primary Topic
Visual Attention and Saliency Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Dual-Stream Bilateral Feature Fusion Network for RGB-D Salient Object Detection

Hanwen Zhou
Visual Attention and Saliency Detection
article

Dual-Stream Bilateral Feature Fusion Network for RGB-D Salient Object Detection

Hanwen Zhou
article en

Abstract

To address the challenges associated with unstable depth map quality in RGB-D salient object detection, this paper introduces a dual-stream network (DSN) architecture that independently processes RGB and depth image inputs while merging these modalities using a multi-scale fusion strategy. Depth maps, however, are often affected by noise and incomplete regions due to sensor limitations, resulting in quality fluctuations that hinder effective multi-modal feature fusion. To mitigate this issue, we incorporate gated convolution into the depth stream, enabling dynamic adjustment of the feature extraction process based on depth map quality. This approach effectively suppresses low-quality depth information, facilitating the efficient integration of depth and RGB features. Consequently, the network can extract valuable geometric information from low-quality depth maps, maintaining high detection accuracy in complex scenes. Extensive experiments on multiple public datasets show that the proposed method significantly enhances performance in salient object detection tasks.

Chongqing Normal University (CN)
Reduced inequalities
Openalex Percentile: Top 75%
Visual Attention and Saliency Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Dual-Stream Bilateral Feature Fusion Network for RGB-D Salient Object Detection — Hanwen Zhou · (2024) | TGRS Research Map | TGRS