British Sign Language in Embodied Music Interaction: An exploratory study of British Sign Language music interpretation

This paper introduces a framework for studying how British Sign Language (BSL) interpreters convey music to hard-of-hearing audiences. It includes a pilot study evaluating the framework and initial data analysis. The work emphasises the use of BSL and body movements to convey a song's musical and sonic qualities, with or without lyrics. Data collection employed qualitativemethods including online surveys and remote interviews with a music-specialised BSL interpreter, analysed through a grounded theory approach, along with quantitative methods using custom Python scripts for computer vision and audio analysis. Three BSL professionals specialising in interpreting accessible live concerts for the hard of hearing participated, providing data for motion capture, facial expressions, hand gestures, and audio analysis (spectral, temporal, and amplitude). The paper reports on framework evaluation, exploratory data analysis, and future research directions.This study contributes a first exploration of how British Sign Language can be used to interpret and communicate musical features, highlighting methodological challenges and opportunities for multimodal accessibility.