Unsupervised Salient Object Detection on Light Field With High-Quality Synthetic Labels
Most current Light Field Salient Object Detection (LFSOD) methods require full supervision with labor-intensive pixel-level annotations. Unsupervised Light Field Salient Object Detection (ULFSOD) has gained attention due to this limitation. However, existing methods use traditional handcrafted techniques to generate noisy pseudo-labels, which degrades the performance of models trained on them. To mitigate this issue, we present a novel learning-based approach to synthesize labels for ULFSOD. We introduce a prominent focal stack identification module that utilizes light field information (focal stack, depth map, and RGB color image) to generate high-quality pixel-level pseudo-labels, aiding network training. Additionally, we propose a novel model architecture for LFSOD, combining a multi-scale spatial attention module for focal stack information with a cross fusion module for RGB and focal stack integration. Through extensive experiments, we demonstrate that our pseudo-label generation method significantly outperforms existing methods in label quality. Our proposed model, trained with our labels, shows significant improvement on ULFSOD, achieving new state-of-the-art scores across public benchmarks.
Authors
- Ying Cao (ORCID: https://orcid.org/0000-0002-9288-3167)
- Pengjie Wang (ORCID: https://orcid.org/0000-0003-1276-9776)
- Xiaosong Yang (ORCID: https://orcid.org/0000-0003-3815-0584)
- Nan Yin (ORCID: https://orcid.org/0000-0002-0177-8514)
- Lin Zheng (ORCID: https://orcid.org/0000-0002-8057-4949)
- Yanfeng Zheng
- Weiwei Xu (ORCID: https://orcid.org/0000-0003-3756-3539)
- Zhong Luo
Institutions
- ShanghaiTech University (CN)
- Mohamed bin Zayed University of Artificial Intelligence (AE)
- State Key Laboratory of Chemical Engineering (CN)
- Dalian Minzu University (CN)
- Zhejiang University (CN)
- Bournemouth University (GB)
- Tsinghua University (CN)
Publication Details
- Journal
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2024-12-11
- DOI
- https://doi.org/10.1109/tcsvt.2024.3514754
- Citations
- 4
- Primary Topic
- Infrared Target Detection Methodologies
- Type
- article
- Field-Weighted Citation Impact
- 5.20