Dual perception-aware blind image quality assessment with semantic-distortion integration and dynamic global–local refinement

Deep neural networks have shown remarkable progress in blind image quality assessment. However, accurately modeling human visual perception remains challenging due to the wide variations in image content and the complex interplay of distortion types. Existing methods, relying on content-agnostic or fixed receptive field approaches, struggle to capture adaptive perceptual features linking semantic regions and distortion perception. To address these limitations, we propose the dual perception-aware model, a two-stage framework integrating semantic- and distortion-aware representations, and then exploring dynamic global–local feature extraction. First, our method leverages superpixel similarity indicators as semantic-aware representations that capture perceptually coherent regions, enabling subsequent content-adaptive feature extraction beyond traditional grid-based methods. A cross-attention mechanism then facilitates mutual modulation between semantic importance and distortion sensitivity, allowing the model to focus on perceptually critical areas while maintaining distortion awareness. Second, we design an adaptive parallel feature extraction unit combining vision transformer blocks with enhanced adaptive filtering residual blocks, achieving comprehensive global–local feature representation that adapts to image-specific characteristics, followed by a weighted dual-pathway regressor for content-tailored quality predictions. Extensive experiments on benchmark datasets containing both synthetic and authentic distortions demonstrate superior performance compared to state-of-the-art methods, with comprehensive ablation studies validating the effectiveness of each proposed component. • Develop a novel dual-stage framework with semantic-distortion integration. • Design a dynamic global–local feature extraction with content adaptation. • Utilize a cross-attention mechanism for adaptive perceptual region focusing. • Demonstrate superior performance over existing methods.

Authors

Institutions

Publication Details

Journal
Displays
Published
2026-02-09
DOI
https://doi.org/10.1016/j.displa.2026.103357
Primary Topic
Image and Video Quality Assessment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Dual perception-aware blind image quality assessment with semantic-distortion integration and dynamic global–local refinement

Yong Xu, Yun Liang, Jing Li, Yuting Xiao et al.
Displays
Image and Video Quality Assessment
article

Dual perception-aware blind image quality assessment with semantic-distortion integration and dynamic global–local refinement

Yong Xu, Yun Liang, Jing Li, Yuting Xiao, Jiabin Zhang, Hongyu Wang, Patrick Le Callet, Zihan Zhou
article en

Abstract

Deep neural networks have shown remarkable progress in blind image quality assessment. However, accurately modeling human visual perception remains challenging due to the wide variations in image content and the complex interplay of distortion types. Existing methods, relying on content-agnostic or fixed receptive field approaches, struggle to capture adaptive perceptual features linking semantic regions and distortion perception. To address these limitations, we propose the dual perception-aware model, a two-stage framework integrating semantic- and distortion-aware representations, and then exploring dynamic global–local feature extraction. First, our method leverages superpixel similarity indicators as semantic-aware representations that capture perceptually coherent regions, enabling subsequent content-adaptive feature extraction beyond traditional grid-based methods. A cross-attention mechanism then facilitates mutual modulation between semantic importance and distortion sensitivity, allowing the model to focus on perceptually critical areas while maintaining distortion awareness. Second, we design an adaptive parallel feature extraction unit combining vision transformer blocks with enhanced adaptive filtering residual blocks, achieving comprehensive global–local feature representation that adapts to image-specific characteristics, followed by a weighted dual-pathway regressor for content-tailored quality predictions. Extensive experiments on benchmark datasets containing both synthetic and authentic distortions demonstrate superior performance compared to state-of-the-art methods, with comprehensive ablation studies validating the effectiveness of each proposed component. • Develop a novel dual-stage framework with semantic-distortion integration. • Design a dynamic global–local feature extraction with content adaptation. • Utilize a cross-attention mechanism for adaptive perceptual region focusing. • Demonstrate superior performance over existing methods.

DisplaysVol. 93
École Centrale de Nantes (FR), South China Agricultural University (CN), Centre National de la Recherche Scientifique (FR), Key Laboratory of Guangdong Province (CN), Laboratoire des Sciences du Numérique de Nantes (FR), Alibaba Group (China) (CN), South China University of Technology (CN), Nantes Université (FR)
Openalex Percentile: Top 63%
Image and Video Quality Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.