No-Reference Speech Intelligibility Prediction Leveraging a Noisy-Speech ASR Pre-Trained Model
Recent advances in deep learning have improved the capabilities of data-driven speech intelligibility prediction (SIP) algorithms. Nevertheless, the scarcity of speech intelligibility datasets limits the development of data-driven algorithms. This study introduces a set of no-reference SIP algorithms leveraging a pre-trained wav2vec 2.0 backbone. We adapt wav2vec 2.0 for automatic speech recognition under additive noise conditions with a parameter-efficient methodology, low-rank adaptation. We demonstrate no-reference SIP algorithms designed with this approach using a moderate amount of training data. The best designs perform on par or even better than a state-of-the-art reference-based SIP algorithm across a variety of datasets comprising different degradation types.
Authors
- Iván López‐Espejo (ORCID: https://orcid.org/0000-0001-8634-7897)
- Amin Edraki (ORCID: https://orcid.org/0000-0002-0843-5522)
- Haolan Wang (ORCID: https://orcid.org/0009-0008-3532-3455)
- Jesper Jensen (ORCID: https://orcid.org/0000-0003-1478-622X)
- Wai-Yip Chan (ORCID: https://orcid.org/0000-0001-5322-2449)
Institutions
- William Demant Holding (Denmark) (DK)
- Aalborg University (DK)
Publication Details
- Published
- 2024-09-01
- DOI
- https://doi.org/10.21437/interspeech.2024-1421
- Primary Topic
- Speech Recognition and Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Ministerio de Ciencia e Innovación
- William Demant Fonden