Multilevel Semantic-Aware Model for AI-Generated Video Quality Assessment
The rapid development of diffusion models has greatly advanced AI-generated videos in terms of length and consistency recently, yet assessing AI-generated videos still remains challenging. Previous approaches have often focused on User-Generated Content(UGC), but few have targeted AI-Generated Video Quality Assessment methods. In this work, we introduce MSA-VQA, a Multilevel Semantic-Aware Model for AI-Generated Video Quality Assessment, which leverages CLIP-based semantic supervision and cross-attention mechanisms. Our hierarchical framework analyzes video content at three levels: frame, segment, and video. We propose a Prompt Semantic Supervision Module using text encoder of CLIP to ensure semantic consistency between videos and conditional prompts. Additionally, we propose the Semantic Mutation-aware Module to capture subtle variations between frames. Extensive experiments demonstrate our method achieves state-of-the-art results.
Authors
- Haozhao Wang (ORCID: https://orcid.org/0000-0002-7591-5315)
- Haoran Xu (ORCID: https://orcid.org/0000-0002-9943-6423)
- Junwei He (ORCID: https://orcid.org/0009-0000-3299-3252)
- Jiaze Li (ORCID: https://orcid.org/0009-0007-7038-7043)
- Shiding Zhu
Institutions
- University of Chinese Academy of Sciences (CN)
- Huazhong University of Science and Technology (CN)
- Zhejiang University (CN)
Publication Details
- Published
- 2025-03-12
- DOI
- https://doi.org/10.1109/icassp49660.2025.10889115
- Citations
- 2
- Primary Topic
- Image and Video Quality Assessment
- Type
- article
- Field-Weighted Citation Impact
- 2.55
Funders
- National Natural Science Foundation of China