Art Comes From Life: Artistic Image Aesthetics Assessment via Attribute Knowledge Amalgamation
Assessing the aesthetic quality and visual appeal of artworks has become one of the hotspots in current research. The existing artistic image aesthetics assessment (AIAA) methods directly learn aesthetics from images, while ignoring the impact of variations in visual attributes on human aesthetic perception, which hampers the further development of AIAA. To address this issue, this paper presents a new AIAA method based on attribute knowledge amalgamation, named AKA-Net. Specifically, we initially learn common attribute aesthetic rules (e.g., composition and color) through pre-training on natural aesthetic images. Then, we devise a multi-model amalgamation strategy based on contrastive learning to transfer different types of prior attribute knowledge into a single target model, enabling flexible and efficient aesthetic prediction. Finally, an attribute-aware feature enhancement module (AFEM) is introduced to better establish the relationship between aesthetic quality and attribute knowledge. Experimental results on three public benchmark AIAA databases demonstrate that the proposed AKA-Net outperforms the state-of-the-art AIAA metrics.
Authors
- Qiuping Jiang (ORCID: https://orcid.org/0000-0002-6025-9343)
- Baoyang Mu (ORCID: https://orcid.org/0000-0003-2898-0461)
- Hangwei Chen (ORCID: https://orcid.org/0000-0002-3756-2029)
- Xiongli Chai (ORCID: https://orcid.org/0000-0002-4245-5391)
- Feng Shao (ORCID: https://orcid.org/0000-0002-2495-9924)
Institutions
- Ningbo University (CN)
Publication Details
- Journal
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2024-12-20
- DOI
- https://doi.org/10.1109/tcsvt.2024.3520616
- Citations
- 2
- Primary Topic
- Aesthetic Perception and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 0.69
Funders
- National Natural Science Foundation of China