Unsupervised Salient Object Detection on Light Field With High-Quality Synthetic Labels

Most current Light Field Salient Object Detection (LFSOD) methods require full supervision with labor-intensive pixel-level annotations. Unsupervised Light Field Salient Object Detection (ULFSOD) has gained attention due to this limitation. However, existing methods use traditional handcrafted techniques to generate noisy pseudo-labels, which degrades the performance of models trained on them. To mitigate this issue, we present a novel learning-based approach to synthesize labels for ULFSOD. We introduce a prominent focal stack identification module that utilizes light field information (focal stack, depth map, and RGB color image) to generate high-quality pixel-level pseudo-labels, aiding network training. Additionally, we propose a novel model architecture for LFSOD, combining a multi-scale spatial attention module for focal stack information with a cross fusion module for RGB and focal stack integration. Through extensive experiments, we demonstrate that our pseudo-label generation method significantly outperforms existing methods in label quality. Our proposed model, trained with our labels, shows significant improvement on ULFSOD, achieving new state-of-the-art scores across public benchmarks.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Circuits and Systems for Video Technology
Published
2024-12-11
DOI
https://doi.org/10.1109/tcsvt.2024.3514754
Citations
4
Primary Topic
Infrared Target Detection Methodologies
Type
article
Field-Weighted Citation Impact
5.20
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Unsupervised Salient Object Detection on Light Field With High-Quality Synthetic Labels

Ying Cao, Pengjie Wang, Xiaosong Yang, Nan Yin et al.
4 citations
IEEE Transactions on Circuits and Systems for Video Technology
Infrared Target Detection Methodologies
5.20
article

Unsupervised Salient Object Detection on Light Field With High-Quality Synthetic Labels

Ying Cao, Pengjie Wang, Xiaosong Yang, Nan Yin, Lin Zheng, Yanfeng Zheng, Weiwei Xu, Zhong Luo
article en
4 citations

Abstract

Most current Light Field Salient Object Detection (LFSOD) methods require full supervision with labor-intensive pixel-level annotations. Unsupervised Light Field Salient Object Detection (ULFSOD) has gained attention due to this limitation. However, existing methods use traditional handcrafted techniques to generate noisy pseudo-labels, which degrades the performance of models trained on them. To mitigate this issue, we present a novel learning-based approach to synthesize labels for ULFSOD. We introduce a prominent focal stack identification module that utilizes light field information (focal stack, depth map, and RGB color image) to generate high-quality pixel-level pseudo-labels, aiding network training. Additionally, we propose a novel model architecture for LFSOD, combining a multi-scale spatial attention module for focal stack information with a cross fusion module for RGB and focal stack integration. Through extensive experiments, we demonstrate that our pseudo-label generation method significantly outperforms existing methods in label quality. Our proposed model, trained with our labels, shows significant improvement on ULFSOD, achieving new state-of-the-art scores across public benchmarks.

IEEE Transactions on Circuits and Systems for Video TechnologyVol. 35(5)
ShanghaiTech University (CN), Mohamed bin Zayed University of Artificial Intelligence (AE), State Key Laboratory of Chemical Engineering (CN), Dalian Minzu University (CN), Zhejiang University (CN), Bournemouth University (GB), Tsinghua University (CN)
Climate action
Openalex Percentile: Top 5%
Infrared Target Detection Methodologies
5.20
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.