Aliasing Detection in Rendered Images via a Multi-Task Learning

As technology advances from simple 2D designs to intricate 3D environments, the demand for high-quality visuals in video games and interactive media necessitates robust image quality assessment (IQA) techniques. Traditional methods like PSNR and SSIM, reliant on reference images, struggle with the unique challenges of 3D rendered content, highlighting the need for specialized non-reference IQA approaches. This paper introduces a novel multi-task learning architecture that corrects and predicts aliasing artifacts simultaneously, enhancing predictive accuracy without reference images. It also incorporates temporal information to improve visual coherence and smoothness. An automated labeling pipeline developed using Unity ensures a stable and unbiased dataset for model training and evaluation. Our experiments demonstrate that this approach reliably detects aliasing across various complexities, achieving state-of-the-art performance. By addressing specific challenges in rendered image assessment and leveraging innovative learning techniques, our work advances IQA for video games and simulations, ensuring high visual quality.

Authors

Institutions

Publication Details

Journal
Proceedings of the ACM on Computer Graphics and Interactive Techniques
Published
2024-08-09
DOI
https://doi.org/10.1145/3675379
Primary Topic
Image and Video Quality Assessment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Aliasing Detection in Rendered Images via a Multi-Task Learning

Kai-Yi Tan, Kai‐Wen Hsiao, Shu-Ho Fan, Chih‐Yuan Yao et al.
Proceedings of the ACM on Computer Graphics and Interactive Techniques
Image and Video Quality Assessment
article

Aliasing Detection in Rendered Images via a Multi-Task Learning

Kai-Yi Tan, Kai‐Wen Hsiao, Shu-Ho Fan, Chih‐Yuan Yao, Hung‐Kuo Chu
article en

Abstract

As technology advances from simple 2D designs to intricate 3D environments, the demand for high-quality visuals in video games and interactive media necessitates robust image quality assessment (IQA) techniques. Traditional methods like PSNR and SSIM, reliant on reference images, struggle with the unique challenges of 3D rendered content, highlighting the need for specialized non-reference IQA approaches. This paper introduces a novel multi-task learning architecture that corrects and predicts aliasing artifacts simultaneously, enhancing predictive accuracy without reference images. It also incorporates temporal information to improve visual coherence and smoothness. An automated labeling pipeline developed using Unity ensures a stable and unbiased dataset for model training and evaluation. Our experiments demonstrate that this approach reliably detects aliasing across various complexities, achieving state-of-the-art performance. By addressing specific challenges in rendered image assessment and leveraging innovative learning techniques, our work advances IQA for video games and simulations, ensuring high visual quality.

Proceedings of the ACM on Computer Graphics and Interactive TechniquesVol. 7(3)
National Taiwan University of Science and Technology (TW), Tunghai University (TW), National Tsing Hua University (TW)
Openalex Percentile: Top 88%
Image and Video Quality Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Aliasing Detection in Rendered Images via a Multi-Task Learning — Kai-Yi Tan, Kai‐Wen Hsiao, et al. · Proceedings of the ACM on Computer Graphics and Interactive Techniques (2024) | TGRS Research Map | TGRS