Passive Haptic Rehearsal for Augmented Piano Learning in the Wild
Passive haptic learning (PHL) is a method for training motor skills via intensive repetition of haptic stimuli while a user is focused on other tasks. For the practical application of PHL to music education, we propose passive haptic rehearsal (PHR) where PHL is combined with deliberate active practice. We designed a piano teaching system that includes haptic gloves compatible with daily wear, a Casio keyboard with light-up keys, and an online learning portal that enables users to track performance, choose lessons, and connect with the gloves and keyboard. We conducted a longitudinal two-week study in the wild, where 36 participants with musical experience learned to play two piano songs with and without PHR. For 20 participants with complete and valid data, we found that PHR boosted the learning rate for the matching accuracy by 49.7% but did not have a significant effect on learning the notes' rhythm. Participants across all skill levels in the study require approximately two days less to reach mastery on the songs practiced when using PHR. We also confirmed that PHR boosts recall between active practice sessions. We hope that our results and system will enable the deployment of PHL beyond the laboratory.
Authors
- Asha Bhandarkar (ORCID: https://orcid.org/0000-0002-5445-9242)
- Celeste Mason (ORCID: https://orcid.org/0000-0002-5893-6392)
- RajivV Kulkarni (ORCID: https://orcid.org/0000-0003-3095-1790)
- Thad Starner (ORCID: https://orcid.org/0000-0001-8442-7842)
- Scott Gilliland
- Charles Ramey (ORCID: https://orcid.org/0000-0002-8826-7273)
- Caitlyn Seim (ORCID: https://orcid.org/0000-0002-4778-3212)
- Priyanka Rajan (ORCID: https://orcid.org/0009-0001-7557-0994)
- Brahmi Dwivedi (ORCID: https://orcid.org/0000-0001-5392-6534)
- Tan Gemicioglu (ORCID: https://orcid.org/0000-0001-9324-4431)
- Nathan L. Eng (ORCID: https://orcid.org/0009-0009-3425-7772)
- Elijah Hopper
- Adithya Ramanujam (ORCID: https://orcid.org/0000-0002-1760-4391)
Institutions
- Georgia Institute of Technology (US)
- Cornell University (US)
- Stanford University (US)
Publication Details
- Journal
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies
- Published
- 2024-11-21
- DOI
- https://doi.org/10.1145/3699748
- Citations
- 4
- Primary Topic
- Music Technology and Sound Studies
- Type
- article
- Field-Weighted Citation Impact
- 1.00