LASER: Language-Queried Speech Enhancer

The performance of speech enhancement systems may be improved by the introduction of prior signal and noise information into their operation. Including this information as a textual query is desirable, since it is a flexible, intuitive and interpretable interface for human-machine interaction. This has recently gained attention in the field of Language-queried Audio Source Separation (LASS). In this work, we propose LASER, a LAnguage-queried Speech EnhanceR that extends the LASS framework to the speech enhancement task and operates on commands including speech transcription and noise information. Experiments on the VoiceBank-DEMAND dataset confirm that an appropriate approach to include the aforementioned information results in increased perceptual quality in comparison to baseline enhancement approaches, with and without text conditioning.

Authors

Institutions

Publication Details

Published
2024-09-09
DOI
https://doi.org/10.1109/iwaenc61483.2024.10694503
Citations
1
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LASER: Language-Queried Speech Enhancer

Eric Grinstein, Patrick A. Naylor, Timo Gerkmann, Danilo de Oliveira
1 citations
Speech and Audio Processing
0.35
article

LASER: Language-Queried Speech Enhancer

Eric Grinstein, Patrick A. Naylor, Timo Gerkmann, Danilo de Oliveira
article en
1 citations

Abstract

The performance of speech enhancement systems may be improved by the introduction of prior signal and noise information into their operation. Including this information as a textual query is desirable, since it is a flexible, intuitive and interpretable interface for human-machine interaction. This has recently gained attention in the field of Language-queried Audio Source Separation (LASS). In this work, we propose LASER, a LAnguage-queried Speech EnhanceR that extends the LASS framework to the speech enhancement task and operates on commands including speech transcription and noise information. Experiments on the VoiceBank-DEMAND dataset confirm that an appropriate approach to include the aforementioned information results in increased perceptual quality in comparison to baseline enhancement approaches, with and without text conditioning.

Imperial College London (GB)
Openalex Percentile: Top 44%
Speech and Audio Processing
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

LASER: Language-Queried Speech Enhancer — Eric Grinstein, Patrick A. Naylor, et al. · (2024) | TGRS Research Map | TGRS