Interpreting Art: Visual Question Answering in Paintings

It is challenging to respond to queries about paintings because it requires knowledge of both the visual details depicted in the image and the background information learned by studying art history. Using a dataset of paintings and comments from an existing art dataset, we employed state-of-the-art question generation techniques to automatically construct question-answer (QA) pairs in this study. Our study presents the outcomes of this review, along with a structured workflow encompassing phases for Visual Question Answering. In each phase, we explore and discuss the techniques found in literature. Additionally, we examine evaluation techniques employed to gauge the quality of generated Answers. Lastly, we identify areas that need more investigation to improve the current state of knowledge on visual question answering in art.

Authors

Institutions

Publication Details

Published
2025-05-23
DOI
https://doi.org/10.1109/incet64471.2025.11140934
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Interpreting Art: Visual Question Answering in Paintings

V Rama Krishna, Veenu Rani, Ashok Rachapalli, Kanala Raghupathi
Multimodal Machine Learning Applications
article

Interpreting Art: Visual Question Answering in Paintings

V Rama Krishna, Veenu Rani, Ashok Rachapalli, Kanala Raghupathi
article en

Abstract

It is challenging to respond to queries about paintings because it requires knowledge of both the visual details depicted in the image and the background information learned by studying art history. Using a dataset of paintings and comments from an existing art dataset, we employed state-of-the-art question generation techniques to automatically construct question-answer (QA) pairs in this study. Our study presents the outcomes of this review, along with a structured workflow encompassing phases for Visual Question Answering. In each phase, we explore and discuss the techniques found in literature. Additionally, we examine evaluation techniques employed to gauge the quality of generated Answers. Lastly, we identify areas that need more investigation to improve the current state of knowledge on visual question answering in art.

Vassar College (US), Advanced Numerical Research and Analysis Group (IN)
Openalex Percentile: Top 77%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.