Enhancing image quality assessment with ResNet50 and global average pooling

This paper focuses on traditional deep learning-based no-reference (or reference-based) image quality assessment (IQA) methods, enhancing them from the perspective of image feature extraction. It replaces the VGG16 network with the ResNet50 network for feature extraction and uses the Global Average Pooling (GAP) layer instead of FC512. Subsequently, it computes the weighted average of quality scores for different parts of the image to obtain the overall image quality. Specifically, the paper first preprocesses images by cropping, flipping, mirroring, tilting, and other methods to expand the image dataset and make it more reflective of real-world scenarios. Then, it utilizes the ResNet50 network for feature extraction, showing superior performance compared to the VGG network. Finally, a weighted pooling method is employed to derive the ultimate image score. On the TID2013 and CLIVE datasets, the Pearson Linear Correlation Coefficient (PLCC) values are 0.877 and 0.7095, respectively, while the Spearman Rank Order Correlation Coefficient (SROCC) values are 0.8510 and 0.6956. These values surpass those obtained using traditional algorithms like SSIM and GSMD, indicating the superior predictive performance of the new algorithm. Moreover, the proposed algorithm demonstrates advantages in speed and accuracy, meeting real-time application requirements more effectively.

Authors

Institutions

Publication Details

Published
2024-10-24
DOI
https://doi.org/10.1117/12.3050393
Primary Topic
Image and Video Quality Assessment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing image quality assessment with ResNet50 and global average pooling

Lifeng He, Yuyan Chao, Mingjie Zhang, Yichen Guo
Image and Video Quality Assessment
article

Enhancing image quality assessment with ResNet50 and global average pooling

Lifeng He, Yuyan Chao, Mingjie Zhang, Yichen Guo
article en

Abstract

This paper focuses on traditional deep learning-based no-reference (or reference-based) image quality assessment (IQA) methods, enhancing them from the perspective of image feature extraction. It replaces the VGG16 network with the ResNet50 network for feature extraction and uses the Global Average Pooling (GAP) layer instead of FC512. Subsequently, it computes the weighted average of quality scores for different parts of the image to obtain the overall image quality. Specifically, the paper first preprocesses images by cropping, flipping, mirroring, tilting, and other methods to expand the image dataset and make it more reflective of real-world scenarios. Then, it utilizes the ResNet50 network for feature extraction, showing superior performance compared to the VGG network. Finally, a weighted pooling method is employed to derive the ultimate image score. On the TID2013 and CLIVE datasets, the Pearson Linear Correlation Coefficient (PLCC) values are 0.877 and 0.7095, respectively, while the Spearman Rank Order Correlation Coefficient (SROCC) values are 0.8510 and 0.6956. These values surpass those obtained using traditional algorithms like SSIM and GSMD, indicating the superior predictive performance of the new algorithm. Moreover, the proposed algorithm demonstrates advantages in speed and accuracy, meeting real-time application requirements more effectively.

Nagoya Sangyo University (JP), Aichi Prefectural University (JP), Shaanxi University of Science and Technology (CN)
Openalex Percentile: Top 82%
Image and Video Quality Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Enhancing image quality assessment with ResNet50 and global average pooling — Lifeng He, Yuyan Chao, et al. · (2024) | TGRS Research Map | TGRS