A Dual-Stream Cross-Domain Integration Network for RGB-T Salient Object Detection

RGB-T salient object detection enhances the performance of detection in complex scenes by integrating RGB and thermal data, but effective fusion remains challenging. To this end, we propose a dual-stream cross-domain integration network (DSCDNet), which explores the effective integration of spatial and frequency domain features, demonstrating remarkable accuracy and stability. Specifically, in the bimodal integration stage, to deeply extract high-level fusion information from multiple modalities, we introduce the spatial domain bimodal integration module and the frequency domain bimodal integration module. This parallel integration strategy facilitates the deep integration of RGB and thermal image from multiple dimensions. After that, our proposed feature decomposition strategy decomposes the spatial fused features into two streams: region perception stream and detail-aware stream, which interpret spatial features from the perspectives of regional and detail understanding, making the model more flexible and efficient in complex scenes. Further, to maximize the complementary advantages between spatial and frequency domain, we design a cross domain feature alignment module to facilitate the interactive learning between the two domains, thereby providing the model with a more comprehensive and enriched representation perspective. Experimental results demonstrate that the proposed DSCDNet outperforms 11 state-of-the-art (SOTA) methods.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Consumer Electronics
Published
2024-11-20
DOI
https://doi.org/10.1109/tce.2024.3502692
Citations
3
Primary Topic
Visual Attention and Saliency Detection
Type
article
Field-Weighted Citation Impact
0.75

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Dual-Stream Cross-Domain Integration Network for RGB-T Salient Object Detection

Yixiu Liu, Xiaowei Cheng, Xiaosheng Yu, Zhigao Zheng
3 citations
IEEE Transactions on Consumer Electronics
Visual Attention and Saliency Detection
0.75
article

A Dual-Stream Cross-Domain Integration Network for RGB-T Salient Object Detection

Yixiu Liu, Xiaowei Cheng, Xiaosheng Yu, Zhigao Zheng
article en
3 citations

Abstract

RGB-T salient object detection enhances the performance of detection in complex scenes by integrating RGB and thermal data, but effective fusion remains challenging. To this end, we propose a dual-stream cross-domain integration network (DSCDNet), which explores the effective integration of spatial and frequency domain features, demonstrating remarkable accuracy and stability. Specifically, in the bimodal integration stage, to deeply extract high-level fusion information from multiple modalities, we introduce the spatial domain bimodal integration module and the frequency domain bimodal integration module. This parallel integration strategy facilitates the deep integration of RGB and thermal image from multiple dimensions. After that, our proposed feature decomposition strategy decomposes the spatial fused features into two streams: region perception stream and detail-aware stream, which interpret spatial features from the perspectives of regional and detail understanding, making the model more flexible and efficient in complex scenes. Further, to maximize the complementary advantages between spatial and frequency domain, we design a cross domain feature alignment module to facilitate the interactive learning between the two domains, thereby providing the model with a more comprehensive and enriched representation perspective. Experimental results demonstrate that the proposed DSCDNet outperforms 11 state-of-the-art (SOTA) methods.

IEEE Transactions on Consumer ElectronicsVol. 71(1)
Wuhan University (CN), Hangzhou Dianzi University (CN), Northeastern University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 27%
Visual Attention and Saliency Detection
0.75
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Dual-Stream Cross-Domain Integration Network for RGB-T Salient Object Detection — Yixiu Liu, Xiaowei Cheng, et al. · IEEE Transactions on Consumer Electronics (2024) | TGRS Research Map | TGRS