CrAIzy MIDI: AI-powered Wearable Musical Instrumental for Novice Player
Playing music is a deeply fulfilling and universally cherished activity, yet the steep learning curve often discourages novice amateurs. Traditional music creation demands significant time and effort to master musical theory, instrumental mechanics, motor skills, and notation reading. To lower these barriers, innovative technology-driven approaches are necessary. This proposal introduces CrAIzy MIDI, an AI-powered wearable musical instrument designed to simplify and enhance the music-playing experience for beginners. CrAIzy MIDI integrates three key technologies: wearable user interfaces, AI-generated music, and multi-modality tools. The wearable interface allows users to play multiple instruments using intuitive finger and palm movements, reducing the complexity of traditional instruments. AI-generated music segments enable users to input a few pitches and have the AI complete the musical piece, aiding beginners in overcoming composition challenges. The multi-modality experience enhances engagement by allowing adjustments in music effects through visual stimuli such as light color and intensity changes. Together, these features make music creation more accessible and enjoyable, fostering continuous practice and exploration for novice musicians.
Authors
- Hongni Ye (ORCID: https://orcid.org/0000-0002-0294-924X)
- Xiangrong Zhu (ORCID: https://orcid.org/0009-0001-2801-2199)
- Yongbo Yang
Institutions
- Tongji University (CN)
- Hong Kong University of Science and Technology (HK)
- University of Hong Kong (HK)
Publication Details
- Published
- 2024-10-11
- DOI
- https://doi.org/10.1145/3672539.3686735
- Citations
- 1
- Primary Topic
- Music Technology and Sound Studies
- Type
- article
- Field-Weighted Citation Impact
- 0.25