Enhanced Learning Experiences Using Gamification and AI in Music Activities

This study introduces “Seeing Sound, Hearing Color," a novel educational game aimed at exploring the complex interplay between sound and color using an interdisciplinary and AI-enhanced pedagogical framework. The game, conducted from September 2023 to January 2024, was developed in conjunction with the exhibition of Merlin’s paintings, showcased in February 2024 in Novo Mesto, Slovenia. In this game, 14 students were engaged from the School Center Novo Mesto, SGLVŠ, as part of their music expression curriculum. The activities incorporated elements of science, art, and artificial intelligence to enable students to study cross-modal perception. Students examined colours from Merlin's paintings and converted these visual stimuli into 32 musical excerpts, promoting a profound synthesis of artistic interpretation and scientific concepts. This study underscored the need of innovative learning environments by fostering inspiration, inventiveness, and self-expression. The study emphasises the educational significance of multisensory and interdisciplinary methods, illustrating how artificial intelligence may improve student engagement and enrich comprehension in both artistic and scientific domains.