Chatbots and Art Critique: A Comparative Study of Chatbot and Human Experts in Traditional Chinese Painting Education

Driven by the recent incorporation of chatbots into art education, art critique as a key factor in this realm poses distinct challenges and opportunities for this technology intervention. This study investigates the efficacy of chatbot-generated critiques in art education and compares them to critiques from human specialists. We conducted an empirical analysis by evaluating both chatbot and human critiques of traditional Chinese paintings, focusing on "The Four Gentlemen", plum, orchid, bamboo, and chrysanthemum, representative themes in traditional Chinese art (Figure 1). Traditional Chinese paintings provide an ideal subject for this research owing to their metaphorical meanings and cultural depth, which provides a complex context for evaluating the nuanced capabilities of chatbots and human critiques. Our analysis looked into several critical dimensions of critique quality. The preliminary results suggest that while chatbot critiques are detailed and relevant, they lack the depth and emotional engagement that are characteristic in human critiques. Human critiques appeared to be way more nuanced and contextual with more emphasis on the symbolic and cultural layers of the artwork. The findings of this research signify that chatbots can play a role in art education and elevate the learning experience through immediate and structured critique. However, they are not able to replace the deeper insights offered from human critiques. Accordingly, this study recommends a hybrid approach: chatbots act as a supplementary pedagogical role, enriching art education and critique. The conclusions suggest further research into the integration of chatbots within art educational settings is needed, encouraging refinement of the design and application of chatbots in creative domains.