Memory-augmented vision transformers with class activation mapping for authenticity and clarity evaluation in digital art

Art has long been recognized as a central medium of cultural expression, education, and human creativity. However, the rapid enhancements of advanced AI tools such as Stable Diffusion, Midjourney, and DALL·E has introduced large volumes of synthetic images that disguise the boundaries between authentic human artwork and machine-generated creations. This need raises critical challenges for evaluating the clarity and authenticity of digital art, particularly in distinguishing whether a piece is real or artificially generated. Traditional image analysis methods, primarily relying on traditional features or convolutional neural networks (CNN), limitations in capturing both fine-grained textures and global artistic composition. To address this challenge, this study proposes a Memory-Augmented Vision Transformer (MeMViT), an integrated EfficientNet-based mechanism works using hierarchical transformer model enhanced with masked attention and memory tokens to efficiently capture both local and global image dependencies. The model was trained on a balanced dataset of 60,000 images, comprising equal proportions of AI-generated and real artwork. For comparison, several baselines, including CNN, DenseNet, AlexNet, and a standard ViT, were also evaluated. Experimental results demonstrate that the proposed model achieves the highest classification accuracy of 97%, outperforming all baselines. Furthermore, model interpretability was ensured using Grad-CAM visualizations and LIME analysis, providing transparent insights into decision-making for art clarity evaluation which shows the AI’s impact on creative authenticity.

Authors

Institutions

Publication Details

Journal
Discover Artificial Intelligence
Published
2026-05-30
DOI
https://doi.org/10.1007/s44163-026-01479-7
Primary Topic
Aesthetic Perception and Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Memory-augmented vision transformers with class activation mapping for authenticity and clarity evaluation in digital art

Qun Pang, Tang Jiexiao
Discover Artificial Intelligence
Aesthetic Perception and Analysis
article

Memory-augmented vision transformers with class activation mapping for authenticity and clarity evaluation in digital art

Qun Pang, Tang Jiexiao
article en

Abstract

Art has long been recognized as a central medium of cultural expression, education, and human creativity. However, the rapid enhancements of advanced AI tools such as Stable Diffusion, Midjourney, and DALL·E has introduced large volumes of synthetic images that disguise the boundaries between authentic human artwork and machine-generated creations. This need raises critical challenges for evaluating the clarity and authenticity of digital art, particularly in distinguishing whether a piece is real or artificially generated. Traditional image analysis methods, primarily relying on traditional features or convolutional neural networks (CNN), limitations in capturing both fine-grained textures and global artistic composition. To address this challenge, this study proposes a Memory-Augmented Vision Transformer (MeMViT), an integrated EfficientNet-based mechanism works using hierarchical transformer model enhanced with masked attention and memory tokens to efficiently capture both local and global image dependencies. The model was trained on a balanced dataset of 60,000 images, comprising equal proportions of AI-generated and real artwork. For comparison, several baselines, including CNN, DenseNet, AlexNet, and a standard ViT, were also evaluated. Experimental results demonstrate that the proposed model achieves the highest classification accuracy of 97%, outperforming all baselines. Furthermore, model interpretability was ensured using Grad-CAM visualizations and LIME analysis, providing transparent insights into decision-making for art clarity evaluation which shows the AI’s impact on creative authenticity.

Discover Artificial Intelligence
Hefei Normal University (CN), Qingdao Huanghai University (CN)
Openalex Percentile: Top 5%
Aesthetic Perception and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.