LASER: Language-Queried Speech Enhancer
The performance of speech enhancement systems may be improved by the introduction of prior signal and noise information into their operation. Including this information as a textual query is desirable, since it is a flexible, intuitive and interpretable interface for human-machine interaction. This has recently gained attention in the field of Language-queried Audio Source Separation (LASS). In this work, we propose LASER, a LAnguage-queried Speech EnhanceR that extends the LASS framework to the speech enhancement task and operates on commands including speech transcription and noise information. Experiments on the VoiceBank-DEMAND dataset confirm that an appropriate approach to include the aforementioned information results in increased perceptual quality in comparison to baseline enhancement approaches, with and without text conditioning.
Authors
- Eric Grinstein (ORCID: https://orcid.org/0000-0003-4502-5407)
- Patrick A. Naylor (ORCID: https://orcid.org/0000-0001-8546-8013)
- Timo Gerkmann (ORCID: https://orcid.org/0000-0002-8678-4699)
- Danilo de Oliveira
Institutions
- Imperial College London (GB)
Publication Details
- Published
- 2024-09-09
- DOI
- https://doi.org/10.1109/iwaenc61483.2024.10694503
- Citations
- 1
- Primary Topic
- Speech and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 0.35