Musinger: Communication of Music over a Distance with Wearable Haptic Display and Touch Sensitive Surface
This study explores the integration of auditory and tactile experiences in musical haptics, focusing on enhancing sensory dimensions of music through touch. Addressing the gap in translating auditory signals to meaningful tactile feedback, our research introduces a novel method involving a touch-sensitive recorder and a wearable haptic display that captures musical interactions via Force Sensitive Resistor (FSR) and converts these into tactile sensations. Previous studies have shown the potential of haptic feedback to enhance musical expressivity, yet challenges remain in conveying complex musical nuances. Our method aims to expand music accessibility for individuals with hearing impairments and deepen digital musical interactions. Experimental results reveal high user melodies recognition through tactile feedback (93% without noise cancellation and 98% without noise cancelation), demonstrating effective transmission and perception of musical information. The findings highlight the potential of haptic technology to bridge sensory gaps, offering significant implications for music therapy, education, and remote musical collaboration, advancing the field of musical haptics and multi-sensory technology applications.
Authors
- Muhammad Haris Khan (ORCID: https://orcid.org/0000-0002-0275-1524)
- Miguel Altamirano Cabrera (ORCID: https://orcid.org/0000-0002-5974-9257)
- Luis Moreno‐Izquierdo (ORCID: https://orcid.org/0000-0003-3260-5883)
- Dzmitry Tsetserukou (ORCID: https://orcid.org/0000-0001-8055-5345)
- Ali Alabbas
- Issatay Tokmurziyev
Institutions
- Skolkovo Institute of Science and Technology (RU)
Publication Details
- Published
- 2024-12-10
- DOI
- https://doi.org/10.1109/robio64047.2024.10907333
- Citations
- 1
- Primary Topic
- Tactile and Sensory Interactions
- Type
- article
- Field-Weighted Citation Impact
- 0.34
Funders
- Russell Sage Foundation