TripleNet: Exploiting Complementary Features and Pseudo-Labels for Semi-Supervised Salient Object Detection
Due to the limited output categories, semi-supervised salient object detection faces challenges in adapting conventional semi-supervised strategies. To address this limitation, we propose a multi-branch architecture that extracts complementary features from labeled data. Specifically, we introduce TripleNet, a three-branch network architecture designed for contour, content, and holistic saliency prediction. The supervision signals for the contour and content branches are derived by decomposing the limited ground truths. After training on the labeled data, the model produces pseudo-labels for unlabeled images, including contour, content, and salient objects. By leveraging the complementarity between the contour and content branches, we construct coupled pseudo-saliency labels by integrating the pseudo-contour and pseudo-content labels, which differ from the model-inferred pseudo-saliency labels. We further develop an enhanced pseudo-labeling mechanism that generates enhanced pseudo-saliency labels by combining reliable regions from both pseudo-saliency labels. Moreover, we incorporate a partial binary cross-entropy loss function to guide the learning of the saliency branch to focus on effective regions within the enhanced pseudo-saliency labels, which are identified through our adaptive thresholding approach. Extensive experiments demonstrate that the proposed method achieves state-of-the-art performance using only 329 labeled training images.
Authors
- Liyuan Chen (ORCID: https://orcid.org/0000-0001-7816-5874)
- Jian Pu (ORCID: https://orcid.org/0000-0002-0892-1213)
- Zhonglong Zheng
- Ming–Hsuan Yang (ORCID: https://orcid.org/0000-0003-4848-2304)
Institutions
- Zhejiang Normal University (CN)
- University of California, Merced (US)
- Fudan University (CN)
- Shanghai Institute for Science of Science (CN)
- Shanghai Center for Brain Science and Brain-Inspired Technology (CN)
Publication Details
- Journal
- IEEE Transactions on Image Processing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tip.2025.3601334
- Citations
- 2
- Primary Topic
- Visual Attention and Saliency Detection
- Type
- article
- Field-Weighted Citation Impact
- 2.55
Funders
- National Natural Science Foundation of China
- National Key Research and Development Program of China