Global-aware Interaction Network for RGB-D salient object detection

Most existing RGB-D salient object detection (SOD) methods rely on depth images to complement RGB images, improving detection accuracy. However, under complex or low-light conditions, the poor quality of depth images often introduces substantial interference, negatively affecting model performance. Consequently, effectively integrating complementary information from both RGB and depth images remains a significant challenge in this field. In this paper, we propose a Global-aware Interaction Network (GAINet) for RGB-D SOD to better capture depth image cues and address modality discrepancies. Specifically, we introduce a Cross-Modal Feature Fusion Module (CMFFM), which consists of a Feature Extraction Enhancement (FEE) module and a Modal Interaction (MI) module. The FEE module refines and enhances the features from both RGB and depth images, while the MI module uses depth features to guide the detection of salient objects in the RGB features. Additionally, a Multi-layer Complementary Module (MCM) is designed to further enhance and refine multi-level complementary features, enabling step-by-step decoding of salient feature maps. A hybrid loss function is employed to optimize GAINet’s training process. Extensive experiments show that GAINet outperforms 15 state-of-the-art RGB-D SOD methods across six publicly available datasets. The codes can be found in https://github.com/wzxxmj/GAINet/ . • Capture more depth cues and compensate for differences between modalities. • Enhance features between different modalities. • Capture the context of features and improve the problem of poor image quality. • Refinement of multi-scale features using a parallel selection strategy.

Authors

Publication Details

Journal
Neurocomputing
Published
2024-12-30
DOI
https://doi.org/10.1016/j.neucom.2024.129204
Citations
5
Primary Topic
Visual Attention and Saliency Detection
Type
article
Field-Weighted Citation Impact
1.25
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Global-aware Interaction Network for RGB-D salient object detection

Ling Yu, Zijian Jiang, Fanglin Niu, Han Yu et al.
5 citations
Neurocomputing
Visual Attention and Saliency Detection
1.25
article

Global-aware Interaction Network for RGB-D salient object detection

Ling Yu, Zijian Jiang, Fanglin Niu, Han Yu, Junru Li
article en
5 citations

Abstract

Most existing RGB-D salient object detection (SOD) methods rely on depth images to complement RGB images, improving detection accuracy. However, under complex or low-light conditions, the poor quality of depth images often introduces substantial interference, negatively affecting model performance. Consequently, effectively integrating complementary information from both RGB and depth images remains a significant challenge in this field. In this paper, we propose a Global-aware Interaction Network (GAINet) for RGB-D SOD to better capture depth image cues and address modality discrepancies. Specifically, we introduce a Cross-Modal Feature Fusion Module (CMFFM), which consists of a Feature Extraction Enhancement (FEE) module and a Modal Interaction (MI) module. The FEE module refines and enhances the features from both RGB and depth images, while the MI module uses depth features to guide the detection of salient objects in the RGB features. Additionally, a Multi-layer Complementary Module (MCM) is designed to further enhance and refine multi-level complementary features, enabling step-by-step decoding of salient feature maps. A hybrid loss function is employed to optimize GAINet’s training process. Extensive experiments show that GAINet outperforms 15 state-of-the-art RGB-D SOD methods across six publicly available datasets. The codes can be found in https://github.com/wzxxmj/GAINet/ . • Capture more depth cues and compensate for differences between modalities. • Enhance features between different modalities. • Capture the context of features and improve the problem of poor image quality. • Refinement of multi-scale features using a parallel selection strategy.

NeurocomputingVol. 621
Openalex Percentile: Top 18%
Visual Attention and Saliency Detection
1.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Global-aware Interaction Network for RGB-D salient object detection — Ling Yu, Zijian Jiang, et al. · Neurocomputing (2024) | TGRS Research Map | TGRS