No-Reference Image Quality Assessment via Local and Global Multi-Scale Feature Integration

In the processes of image capture, transmission, processing, and storage, distortions are inevitable, degrading image quality and affecting both perception and information retrieval. Therefore, assessing image quality is crucial. Current deep learning-based no-reference image quality assessment (NR-IQA) methods face challenges: they fail to preserve both local sensitivity and global details through down-sampling, struggle with multi-scale feature extraction across various distortion types, and lack semantic content perception. Addressing these, we propose the Local and Global Multi-scale Feature (LGMF) algorithm for NR-IQA. This method introduces a grid-based random down-sampling module preserving both local and global details, a pyramid vision Transformer for multi-scale feature extraction, and a global semantic prior extraction module enhancing semantic content perception. Further, a cross-attention feature fusion module selectively integrates these elements, significantly improving quality assessments. The LGMF model also functions as a quality-aware loss function, guiding image restoration networks to achieve superior objective and subjective restoration results. Tested across six datasets, LGMF consistently outperforms existing NR-IQA methods, demonstrating superior generalization and effectiveness in image restoration tasks.

Authors

Institutions

Publication Details

Published
2024-10-20
DOI
https://doi.org/10.1145/3689093.3689184
Citations
2
Primary Topic
Image and Video Quality Assessment
Type
article
Field-Weighted Citation Impact
0.50
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

No-Reference Image Quality Assessment via Local and Global Multi-Scale Feature Integration

Gang He, Kepeng Xu, Tong Qiao, Zhenyang Liu
2 citations
Image and Video Quality Assessment
0.50
article

No-Reference Image Quality Assessment via Local and Global Multi-Scale Feature Integration

Gang He, Kepeng Xu, Tong Qiao, Zhenyang Liu
article en
2 citations

Abstract

In the processes of image capture, transmission, processing, and storage, distortions are inevitable, degrading image quality and affecting both perception and information retrieval. Therefore, assessing image quality is crucial. Current deep learning-based no-reference image quality assessment (NR-IQA) methods face challenges: they fail to preserve both local sensitivity and global details through down-sampling, struggle with multi-scale feature extraction across various distortion types, and lack semantic content perception. Addressing these, we propose the Local and Global Multi-scale Feature (LGMF) algorithm for NR-IQA. This method introduces a grid-based random down-sampling module preserving both local and global details, a pyramid vision Transformer for multi-scale feature extraction, and a global semantic prior extraction module enhancing semantic content perception. Further, a cross-attention feature fusion module selectively integrates these elements, significantly improving quality assessments. The LGMF model also functions as a quality-aware loss function, guiding image restoration networks to achieve superior objective and subjective restoration results. Tested across six datasets, LGMF consistently outperforms existing NR-IQA methods, demonstrating superior generalization and effectiveness in image restoration tasks.

Xidian University (CN)
Openalex Percentile: Top 34%
Image and Video Quality Assessment
0.50
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

No-Reference Image Quality Assessment via Local and Global Multi-Scale Feature Integration — Gang He, Kepeng Xu, et al. · (2024) | TGRS Research Map | TGRS