Multi-Stage Image Aesthetic Assessment via Chain-of-Thought Reasoning
Image Aesthetic Assessment (IAA) is an crucial task in computer vision, aiming to quantify the aesthetic quality of images. Existing methods face two main challenges: neglecting the sequential modeling of human visual perception, and the fact that multi-attribute annotation is extremely time-consuming and labor-intensive. This letter proposes a novel Multi-stage IAA framework, leveraging Chain-of-Thought (CoT) reasoning and Multimodal Large Language Models (MLLMs). The framework designs a system that mimics the chain-like progression of human cognitive processing, with three dedicated modules: Low-level Stimulus Assessment (e.g., color harmony), Holistic Organizing Assessment (e.g., scene semantics), and High-level Perceiving Assessment (e.g., emotional resonance). These modules progressively analyze images, from basic visual features to high-level emotional understanding, by employing a step-by-step reasoning process characteristic of CoT. Furthermore, we explore an MLLM-oriented data transformation paradigm to convert multi-source IAA datasets into structured, Chain-of-Thought-compatible data, facilitating convenient attribute annotation. This enables the MLLMs to effectively learn and apply the CoT reasoning for aesthetic evaluation. Experiment on the PARA dataset achieves state-of-the-art results. Moreover, the framework exhibits generalization capabilities on the unseen FLICKR-AES dataset.
Authors
- Jianhao Liu
- Hongming Li
- Zhuodong Jiang (ORCID: https://orcid.org/0009-0007-6831-0514)
- Yue Liu (ORCID: https://orcid.org/0000-0001-6860-4669)
- Yu Song
Institutions
- University of Science and Technology Beijing (CN)
Publication Details
- Journal
- IEEE Access
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/access.2025.3590925
- Primary Topic
- Aesthetic Perception and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Fundamental Research Funds for the Central Universities