Dual perception-aware blind image quality assessment with semantic-distortion integration and dynamic global–local refinement
Deep neural networks have shown remarkable progress in blind image quality assessment. However, accurately modeling human visual perception remains challenging due to the wide variations in image content and the complex interplay of distortion types. Existing methods, relying on content-agnostic or fixed receptive field approaches, struggle to capture adaptive perceptual features linking semantic regions and distortion perception. To address these limitations, we propose the dual perception-aware model, a two-stage framework integrating semantic- and distortion-aware representations, and then exploring dynamic global–local feature extraction. First, our method leverages superpixel similarity indicators as semantic-aware representations that capture perceptually coherent regions, enabling subsequent content-adaptive feature extraction beyond traditional grid-based methods. A cross-attention mechanism then facilitates mutual modulation between semantic importance and distortion sensitivity, allowing the model to focus on perceptually critical areas while maintaining distortion awareness. Second, we design an adaptive parallel feature extraction unit combining vision transformer blocks with enhanced adaptive filtering residual blocks, achieving comprehensive global–local feature representation that adapts to image-specific characteristics, followed by a weighted dual-pathway regressor for content-tailored quality predictions. Extensive experiments on benchmark datasets containing both synthetic and authentic distortions demonstrate superior performance compared to state-of-the-art methods, with comprehensive ablation studies validating the effectiveness of each proposed component. • Develop a novel dual-stage framework with semantic-distortion integration. • Design a dynamic global–local feature extraction with content adaptation. • Utilize a cross-attention mechanism for adaptive perceptual region focusing. • Demonstrate superior performance over existing methods.
Authors
- Yong Xu
- Yun Liang
- Jing Li
- Yuting Xiao
- Jiabin Zhang
- Hongyu Wang
- Patrick Le Callet
- Zihan Zhou
Institutions
- École Centrale de Nantes (FR)
- South China Agricultural University (CN)
- Centre National de la Recherche Scientifique (FR)
- Key Laboratory of Guangdong Province (CN)
- Laboratoire des Sciences du Numérique de Nantes (FR)
- Alibaba Group (China) (CN)
- South China University of Technology (CN)
- Nantes Université (FR)
Publication Details
- Journal
- Displays
- Published
- 2026-02-09
- DOI
- https://doi.org/10.1016/j.displa.2026.103357
- Primary Topic
- Image and Video Quality Assessment
- Type
- article
- Field-Weighted Citation Impact
- 0.00