Musical practice in audio augmented reality: Testing virtual acoustics using reverb convolution via bone conduction headphones

Bone conduction headphones primarily transmit the audio signal directly to the inner ear. By not obstructing the ear canal, the system facilitates the perception of two layers of sound: a seamless integration of unmediated and virtual sound, enhancing the realism of the latter in an audio augmented reality experience. Our study aims to evaluate the impact of virtual acoustics on the performance of professional musicians. This paper mainly investigates the effect of a real-time convolution-based system that convolves sounds produced by musicians and delivers it to them via bone conduction headphones during musical performance. We investigate the impact of this system on musical practices and compare it to four other practice conditions: (1) an acoustically treated studio, (2) reverb convolution via traditional air conduction headphones, (3) reverb convolution via a loudspeaker-based virtual acoustic system, and (4) a real concert hall, where impulse responses were used for auralization in the virtual acoustics simulation. Data collected from musicians during both ensemble and solo performances—including EEG readings, performance analysis from audiovisual recordings, and surveys—provide, in our knowledge, insights never been conducted before on this research topic.