Context-aware multimodal AI navigates hidden pathways in five centuries of art evolution

The rise of multimodal generative AI transforms the intersection of technology and art, offering richer insights into large-scale artworks. While significant research has focused on their creative potential, their ability to represent artworks in latent spaces remains underexamined. We use generative AI, specifically Stable Diffusion, to analyze 500 y of Western paintings by extracting two types of latent information with the model: formal aspects (e.g., colors) and contextual aspects (e.g., subjects). Our findings reveal that contextual information exhibits stronger vector alignment and orientation with conventional artistic periods, styles, and individual artists than formal elements. Also, we show how artistic expression aligns with historical shifts using contextual keywords extracted from paintings. Our generative experiment, infusing prospective contexts into historical artworks, validates this vector alignment and orientation by synthesizing artworks consistent with the stylistic patterns of target periods. This study demonstrates how multimodal AI expands traditional formal analysis by integrating temporal, cultural, and historical contexts to quantify the latent structure of cultural knowledge.

Authors

Institutions

Publication Details

Journal
Proceedings of the National Academy of Sciences
Published
2026-07-24
DOI
https://doi.org/10.1073/pnas.2517969123
Primary Topic
Aesthetic Perception and Analysis
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Context-aware multimodal AI navigates hidden pathways in five centuries of art evolution

Byunghwee Lee, Taekho You, Jin Kim, Jinhyuk Yun
Proceedings of the National Academy of Sciences
Aesthetic Perception and Analysis
article

Context-aware multimodal AI navigates hidden pathways in five centuries of art evolution

Byunghwee Lee, Taekho You, Jin Kim, Jinhyuk Yun
article en

Abstract

The rise of multimodal generative AI transforms the intersection of technology and art, offering richer insights into large-scale artworks. While significant research has focused on their creative potential, their ability to represent artworks in latent spaces remains underexamined. We use generative AI, specifically Stable Diffusion, to analyze 500 y of Western paintings by extracting two types of latent information with the model: formal aspects (e.g., colors) and contextual aspects (e.g., subjects). Our findings reveal that contextual information exhibits stronger vector alignment and orientation with conventional artistic periods, styles, and individual artists than formal elements. Also, we show how artistic expression aligns with historical shifts using contextual keywords extracted from paintings. Our generative experiment, infusing prospective contexts into historical artworks, validates this vector alignment and orientation by synthesizing artworks consistent with the stylistic patterns of target periods. This study demonstrates how multimodal AI expands traditional formal analysis by integrating temporal, cultural, and historical contexts to quantify the latent structure of cultural knowledge.

Proceedings of the National Academy of SciencesVol. 123(30)
Soongsil University (KR), Korea Advanced Institute of Science and Technology (KR), Max Planck Institute for Security and Privacy (DE), Digital Science (United States) (US), Convergence (US), University of Virginia (US), Indiana University (US)
National Research Foundation of Korea, Institute for Information and Communications Technology Promotion
Openalex Percentile: Top 7%
Aesthetic Perception and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Context-aware multimodal AI navigates hidden pathways in five centuries of art evolution — Byunghwee Lee, Taekho You, et al. · Proceedings of the National Academy of Sciences (2026) | TGRS Research Map | TGRS