Spatial-Perception Fusion and Progressive Refinement Network For RGB-D Camouflaged Object Detection

Camouflaged object detection (COD) presents a significant challenge in accurately identifying objects that seamlessly blend well with their surroundings. Taking inspiration from natural vision systems, we suggest integrating depth images as an additional resource to enhance camouflage detection by providing spatial clues and separation for foreground and background. To address this issue, we innovatively propose Spatial-Perception Fusion and Progressive Refinement Network (SPPNet) to uncover hidden objects in RGB and depth modes, utilizing three components. Initially, we extract features at multiple scales from RGB images and depth maps by a dual stream Swim Transformer encoder. Then, we develop a spatial-perception fusion module that utilizes spatial attention mechanisms to combine features from multiple modalities and levels. Finally, we propose a progressive refinement module that integrates low-level features and refine edge details of predictions to precisely detect camouflaged objects. Our SPPNet outperforms other state-of-the-art COD models on three benchmark camouflaged datasets. Codes can be found at https://github.com/Mercurioy/SPPNet.

Authors

Publication Details

Published
2024-10-25
DOI
https://doi.org/10.1145/3704323.3704326
Primary Topic
Visual Attention and Saliency Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Spatial-Perception Fusion and Progressive Refinement Network For RGB-D Camouflaged Object Detection

Yixuan Kang, Xueqiang Guo, Yu Liu, Xianglong Jin et al.
Visual Attention and Saliency Detection
article

Spatial-Perception Fusion and Progressive Refinement Network For RGB-D Camouflaged Object Detection

Yixuan Kang, Xueqiang Guo, Yu Liu, Xianglong Jin, Cheng Guo
article en

Abstract

Camouflaged object detection (COD) presents a significant challenge in accurately identifying objects that seamlessly blend well with their surroundings. Taking inspiration from natural vision systems, we suggest integrating depth images as an additional resource to enhance camouflage detection by providing spatial clues and separation for foreground and background. To address this issue, we innovatively propose Spatial-Perception Fusion and Progressive Refinement Network (SPPNet) to uncover hidden objects in RGB and depth modes, utilizing three components. Initially, we extract features at multiple scales from RGB images and depth maps by a dual stream Swim Transformer encoder. Then, we develop a spatial-perception fusion module that utilizes spatial attention mechanisms to combine features from multiple modalities and levels. Finally, we propose a progressive refinement module that integrates low-level features and refine edge details of predictions to precisely detect camouflaged objects. Our SPPNet outperforms other state-of-the-art COD models on three benchmark camouflaged datasets. Codes can be found at https://github.com/Mercurioy/SPPNet.

Openalex Percentile: Top 75%
Visual Attention and Saliency Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.