ASSESSMENT OF AI-GENERATED IMAGES USING COMPUTATIONAL METRICS AND HUMAN CENTRIC ANALYSIS

The rapid advancements in AI-generated models for image generation have transformed image creation from entertainment to e-commerce, making robust evaluation essential. We designed and statistically validated a human study for assessing the photorealism and image quality of AI-generated images. The study indicated that camera images show more realism, while AI images, such as those generated by DALL-E2, excel in quality. Further analysis showed that existing metrics deviate from human judgments. To address this, we developed the Global-Local Image Perceptual Score (GLIPS), which evaluates photorealistic quality using Vision Transformer-based attention for local similarity and Maximum Mean Discrepancy (MMD) for global distributional similarity. Our evaluation showed that GLIPS aligns more closely with human perception compared to traditional metrics like FID and SSIM for photorealism, although MS-SSIM outperformed in image quality. Additionally, we introduced the Interpolative Binning Scale (IBS) for human-assisted metric scaling with human scores.

Publication Details

Journal
Scholarship@Western (Western University)
Published
2024-08-15
Primary Topic
Visual Attention and Saliency Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ASSESSMENT OF AI-GENERATED IMAGES USING COMPUTATIONAL METRICS AND HUMAN CENTRIC ANALYSIS

Scholarship@Western (Western University)
Visual Attention and Saliency Detection
article

ASSESSMENT OF AI-GENERATED IMAGES USING COMPUTATIONAL METRICS AND HUMAN CENTRIC ANALYSIS

article en

Abstract

The rapid advancements in AI-generated models for image generation have transformed image creation from entertainment to e-commerce, making robust evaluation essential. We designed and statistically validated a human study for assessing the photorealism and image quality of AI-generated images. The study indicated that camera images show more realism, while AI images, such as those generated by DALL-E2, excel in quality. Further analysis showed that existing metrics deviate from human judgments. To address this, we developed the Global-Local Image Perceptual Score (GLIPS), which evaluates photorealistic quality using Vision Transformer-based attention for local similarity and Maximum Mean Discrepancy (MMD) for global distributional similarity. Our evaluation showed that GLIPS aligns more closely with human perception compared to traditional metrics like FID and SSIM for photorealism, although MS-SSIM outperformed in image quality. Additionally, we introduced the Interpolative Binning Scale (IBS) for human-assisted metric scaling with human scores.

Scholarship@Western (Western University)
Openalex Percentile: Top 58%
Visual Attention and Saliency Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.