Flervalsinlärning i talseparering. Från många till varierande talares separation

This report deals with the speech processing source separation task and introduces Multiple Choice Learning (MCL) to tackle the assignation ambiguity between predictions and ground-truth-separated signals. This inherently ambiguous task is customarily solved using Permutation Invariant Training (PIT) which finds the best assignation at the cost of a computationally expensive procedure. I demonstrate experimentally that MCL, originally introduced to tackle ambiguous tasks, matches the performances of PIT while being computationally advantageous in many-speaker settings. The variable number of speakers separation task is another approach tackled by introducing a scoring model that helps to quantify how "relevant" a prediction is during the separation. It is shown that the scoring model allows improvements in speech separation for 2 and 3-speakers based on a 5-speaker pre-trained model. Two new metrics W_EMD and T_EMD using scores are introduced and enable a better understanding of what the different predictions contain in a variable number of speaker settings. Finally, one can observe separation improvements while using the scoring, which is not detached from the separation.

Publication Details

Journal
KTH Publication Database DiVA (KTH Royal Institute of Technology)
Published
2025-01-01
Primary Topic
Magnetic confinement fusion research
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Flervalsinlärning i talseparering. Från många till varierande talares separation

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Magnetic confinement fusion research
article

Flervalsinlärning i talseparering. Från många till varierande talares separation

article en

Abstract

This report deals with the speech processing source separation task and introduces Multiple Choice Learning (MCL) to tackle the assignation ambiguity between predictions and ground-truth-separated signals. This inherently ambiguous task is customarily solved using Permutation Invariant Training (PIT) which finds the best assignation at the cost of a computationally expensive procedure. I demonstrate experimentally that MCL, originally introduced to tackle ambiguous tasks, matches the performances of PIT while being computationally advantageous in many-speaker settings. The variable number of speakers separation task is another approach tackled by introducing a scoring model that helps to quantify how "relevant" a prediction is during the separation. It is shown that the scoring model allows improvements in speech separation for 2 and 3-speakers based on a 5-speaker pre-trained model. Two new metrics W_EMD and T_EMD using scores are introduced and enable a better understanding of what the different predictions contain in a variable number of speaker settings. Finally, one can observe separation improvements while using the scoring, which is not detached from the separation.

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Grand Équipement National De Calcul Intensif
Peace, Justice and strong institutions
Openalex Percentile: Top 33%
Magnetic confinement fusion research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Flervalsinlärning i talseparering. Från många till varierande talares separation · KTH Publication Database DiVA (KTH Royal Institute of Technology) (2025) | TGRS Research Map | TGRS