Room Acoustic Adversarial Neural Network for Robust Sound Event Classification
The variation in the acoustic condition of a room presents a major hurdle in the performance robustness of sound event classification. Room impulse response characterizes the way in which a sound wave is propagated from source to receiver and the overall perceptual quality and intelligibility of the recorded sound. This study presents the Room Acoustic Adversarial Neural Network (RAANN) method that can make sound event classification more robust to changes in acoustic condition by exploiting knowledge regarding the room acoustics during learning. With RAANN, the weighted F1 score for the classification task improved by 1.54 percentage points, and the standard deviation in performance dropped from 1.74 percentage points to 1.07 percentage points for acoustic conditions that were harder than those seen during the learning phase. The Clarity Index over the first 25 ms emerged as a good metric for the acoustic estimation in the RAANN training.
Authors
- Peter Karsmakers (ORCID: https://orcid.org/0000-0001-8119-6823)
- Wim Desmet (ORCID: https://orcid.org/0000-0003-2016-7863)
- Sreenivasa Upadhyaya
- Wim Buyens
Publication Details
- Journal
- Journal of the Audio Engineering Society
- Published
- 2024-11-15
- DOI
- https://doi.org/10.17743/jaes.2022.0174
- Citations
- 1
- Primary Topic
- Music and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 0.35
Funders
- Agentschap Innoveren en Ondernemen
- Vlaamse regering