Generative Contrastive Learning for Multi-Label Image Classification
The multi-label image classification task aims to predict the labels of multiple objects in an image. Existing research has shown that modeling the frequent co-occurrence relationships between objects can improve model classification performance. However, most current models overemphasize these co-occurrence relationships while neglecting the intrinsic information within the image, resulting in a reduced ability to distinguish between different objects. In this paper, we propose a multi-label image classification method based on contrastive learning to maintain the model's sensitivity to different objects. Traditional contrastive learning methods for multi-label tasks often perform poorly due to the lack of sufficient contrastive samples. To address this, we introduce a generative contrastive learning method, which generates a large number of reliable contrastive samples to enhance the effectiveness of contrastive learning. Our experiments on the MSCOCO2014 dataset show that the proposed method achieves state-of-the-art classification performance.
Authors
- Zheng Gu (ORCID: https://orcid.org/0000-0002-3229-2795)
- Songhua Xu (ORCID: https://orcid.org/0000-0002-2276-2538)
- Dong Wang (ORCID: https://orcid.org/0000-0003-3627-2051)
- Shengwu Fu
Institutions
- South China Agricultural University (CN)
Publication Details
- Published
- 2024-11-01
- DOI
- https://doi.org/10.1109/isdh64927.2024.00019
- Primary Topic
- Text and Document Classification Technologies
- Type
- article
- Field-Weighted Citation Impact
- 0.00