Version 4 Update - Adding Advanced Acoustic Degradation Training for Speech Recognition: Synthetic Data Augmentation Methodology
Traditional automatic speech recognition (ASR) systems fail catastrophically on whispered speech due to a fundamental supervision problem: training data cannot be reliably labeled when expert transcribers cannot hear the audio, even in playback. This paper presents a novel methodology that solves this bottleneck by identifying an existing corpus of transcribable whispered speech in ASMR (Autonomous Sensory Meridian Response) content, which is recorded in clean environments that permit accurate transcription. The methodology combines this training corpus with multimodal input streams (audio, visual speech recognition, and contextual information) to achieve disambiguation that is impossible from acoustic signals alone. We propose a creator partnership model that addresses legal and ethical concerns while creating reciprocal value, and describe privacy-preserving deployment architecture using local processing for biometric data. This approach transforms whisper recognition from an unsolvable supervision problem into a tractable engineering challenge with clear implementation pathways.
Institutions
- Administration of Occupational Safety and Health (IS)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2025-10-21
- DOI
- https://doi.org/10.5281/zenodo.17791263
- Primary Topic
- Speech Recognition and Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 0.00