Camouflaged Object Detection Via Style Transfer-Based Data Augmentation

Infrared (IR) images can be seen as complementary to visible light (RGB) images, as they can capture accurate targets in low-visibility conditions. However, camouflaged object detection (COD) based on RGB and IR images is expensive. To this end, we propose to exploit a style transfer-based data augmentation method to generate pseudo-IR images by absorbing the style information of IR images into RGB images, and to perform COD based on RGB and the pseudo-IR images. For RGB and IR-based COD, we propose a novel Edge-guided Uncertainty-aware Fusion Network (EUFNet), to make better use of the complementarity between the two kinds of images. Specifically, an uncertainty-aware fusion module is first proposed to aggregate RGB and IR features by estimating their uncertainties. Then, an edge enhancement module is proposed to extract and enhance the edge information in multiple stages. Lastly, a hierarchical integration module is designed to integrate RGB and IR features with edge cues. Extensive experiments demonstrate the effectiveness of the generated pseudo-IR images as well as the proposed EUFNet. The code is available at https://github.com/csdahunzi/COD.

Authors

Institutions

Publication Details

Published
2024-09-27
DOI
https://doi.org/10.1109/icip51287.2024.10648134
Primary Topic
Visual Attention and Saliency Detection
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Camouflaged Object Detection Via Style Transfer-Based Data Augmentation

Rong Quan, Jie Qin, Haiyan Chen, Jiaxuan Chen et al.
Visual Attention and Saliency Detection
article

Camouflaged Object Detection Via Style Transfer-Based Data Augmentation

Rong Quan, Jie Qin, Haiyan Chen, Jiaxuan Chen, Ziyi Peng, Dongni Lu
article en

Abstract

Infrared (IR) images can be seen as complementary to visible light (RGB) images, as they can capture accurate targets in low-visibility conditions. However, camouflaged object detection (COD) based on RGB and IR images is expensive. To this end, we propose to exploit a style transfer-based data augmentation method to generate pseudo-IR images by absorbing the style information of IR images into RGB images, and to perform COD based on RGB and the pseudo-IR images. For RGB and IR-based COD, we propose a novel Edge-guided Uncertainty-aware Fusion Network (EUFNet), to make better use of the complementarity between the two kinds of images. Specifically, an uncertainty-aware fusion module is first proposed to aggregate RGB and IR features by estimating their uncertainties. Then, an edge enhancement module is proposed to extract and enhance the edge information in multiple stages. Lastly, a hierarchical integration module is designed to integrate RGB and IR features with edge cues. Extensive experiments demonstrate the effectiveness of the generated pseudo-IR images as well as the proposed EUFNet. The code is available at https://github.com/csdahunzi/COD.

Nanjing University of Aeronautics and Astronautics (CN)
National Natural Science Foundation of China, Natural Science Foundation of Jiangsu Province, Fundamental Research Funds for the Central Universities
Openalex Percentile: Top 84%
Visual Attention and Saliency Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Camouflaged Object Detection Via Style Transfer-Based Data Augmentation — Rong Quan, Jie Qin, et al. · (2024) | TGRS Research Map | TGRS