Cross-Modal Adaptive Interaction Network for RGB-D Saliency Detection

The salient object detection (SOD) task aims to automatically detect the most prominent areas observed by the human eye in an image. Since RGB images and depth images contain different information, how to effectively integrate cross-modal features in the RGB-D SOD task remains a major challenge. Therefore, this paper proposes a cross-modal adaptive interaction network (CMANet) for the RGB-D salient object detection task, which consists of a cross-modal feature integration module (CMF) and an adaptive feature fusion module (AFFM). These modules are designed to integrate and enhance multi-scale features from both modalities, improve the effect of integrating cross-modal complementary information of RGB and depth images, enhance feature information, and generate richer and more representative feature maps. Extensive experiments were conducted on four RGB-D datasets to verify the effectiveness of CMANet. Compared with 17 RGB-D SOD methods, our model accurately detects salient regions in images and achieves state-of-the-art performance across four evaluation metrics.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2024-08-23
DOI
https://doi.org/10.3390/app14177440
Citations
3
Primary Topic
Visual Attention and Saliency Detection
Type
article
Field-Weighted Citation Impact
0.75

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Cross-Modal Adaptive Interaction Network for RGB-D Saliency Detection

Jian Zhao, Qinsheng Du, Jianyu Wu, Yingxu Bian et al.
3 citations
Applied Sciences
Visual Attention and Saliency Detection
0.75
article

Cross-Modal Adaptive Interaction Network for RGB-D Saliency Detection

Jian Zhao, Qinsheng Du, Jianyu Wu, Yingxu Bian, Shiyan Zhang
article en
3 citations

Abstract

The salient object detection (SOD) task aims to automatically detect the most prominent areas observed by the human eye in an image. Since RGB images and depth images contain different information, how to effectively integrate cross-modal features in the RGB-D SOD task remains a major challenge. Therefore, this paper proposes a cross-modal adaptive interaction network (CMANet) for the RGB-D salient object detection task, which consists of a cross-modal feature integration module (CMF) and an adaptive feature fusion module (AFFM). These modules are designed to integrate and enhance multi-scale features from both modalities, improve the effect of integrating cross-modal complementary information of RGB and depth images, enhance feature information, and generate richer and more representative feature maps. Extensive experiments were conducted on four RGB-D datasets to verify the effectiveness of CMANet. Compared with 17 RGB-D SOD methods, our model accurately detects salient regions in images and achieves state-of-the-art performance across four evaluation metrics.

Applied SciencesVol. 14(17)
Changchun University of Science and Technology (CN), Ministry of Education of the People's Republic of China (CN), Health Commission of Jilin Province (CN)
Department of Science and Technology of Jilin Province
Openalex Percentile: Top 28%
Visual Attention and Saliency Detection
0.75
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Cross-Modal Adaptive Interaction Network for RGB-D Saliency Detection — Jian Zhao, Qinsheng Du, et al. · Applied Sciences (2024) | TGRS Research Map | TGRS