Enhancing Visual Art Appreciation through AI-Human Collaboration: A Case Study of Image-Literacy-Aided Instruction with Doubao
This study investigates the integration of AI-assisted dialogue and image-literate instruction in primary art education, grounded in neuroscience models of multisensory information processing. Drawing inspiration from the visual-auditory convergence in the lateral and medial geniculate nuclei, the instructional design leverages Doubao—a conversational AI with voice output—to iteratively engage students in decoding traditional Chinese artworks. Conducted over four weeks with 253 sixth-grade students across six classes, the curriculum focused on selected works from the painting Lady Guoguo's Spring Outing, a classic from the Tang Dynasty and one of the Top Ten Chinese Paintings. Students were guided to observe visual elements, inquire into unfamiliar cultural symbols, and refine their interpretations through voice-augmented AI dialogue. The system's responsive feedback loop encouraged successive questioning, style transfer-based imaginative tasks, and repeated information verification. This process enhanced students’ curiosity and strengthened their ability to evaluate information reliability by layering and comparing contextual cues. Results indicate that combining image and sound through human-AI collaboration fosters deeper engagement, cultural literacy, and metacognitive awareness in visual art learning.
Authors
- Jianzhi Deng (ORCID: https://orcid.org/0000-0002-0256-3355)
- Zhengqing Zhou (ORCID: https://orcid.org/0009-0009-6541-9535)
- C. Liu (ORCID: https://orcid.org/0009-0006-2374-7942)
Institutions
- Beijing Language and Culture University (CN)
- University of Wisconsin–Madison (US)
- Shenzhen University (CN)
- Anshan Hospital (CN)
Publication Details
- Published
- 2025-06-20
- DOI
- https://doi.org/10.1145/3756580.3756653
- Primary Topic
- Multisensory perception and integration
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Beijing Language and Culture University
- Jilin Office of Philosophy and Social Science
- Fundamental Research Funds for the Central Universities