Cross-Lingual Speaker Diarization for Romanian Without Fine-Tuning: End-to-End MSDD Versus a Traditional Segmentation–Embedding–Clustering Pipeline

Speaker diarization is a key component for multiple downstream speech technologies, including speech transcription, meeting analytics, and conversational understanding; however, Romanian lacks publicly established diarization resources and benchmarks. This paper evaluates cross-lingual transfer of diarization systems pretrained on predominantly English data, under a strict no-adaptation policy. We compare an end-to-end neural diarization approach (MSDD) and a traditional modular pipeline (segmentation + speaker embeddings + clustering), both used as is with pretrained components. To enable controlled analysis despite the lack of Romanian diarization datasets, we construct a synthetic Romanian conversational benchmark with explicit conditions on speaker count (2–5) and overlap regime (no overlap versus overlap). We report the diarization error rate (DER) and Jaccard error rate (JER) across all conditions, analyze sensitivity to overlap and the number of speakers, and provide an error-component breakdown to identify dominant failure modes. Across all conditions, the end-to-end system outperforms the pipeline (DER 0.140 versus 0.267; JER 0.152 versus 0.320). Performance degrades with overlap and with increasing speaker count in both paradigms, with speaker confusion dominating the additional error under overlap.

Authors

Institutions

Publication Details

Journal
Electronics
Published
2026-02-12
DOI
https://doi.org/10.3390/electronics15040778
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Cross-Lingual Speaker Diarization for Romanian Without Fine-Tuning: End-to-End MSDD Versus a Traditional Segmentation–Embedding–Clustering Pipeline

Remus-Dan Ungureanu, Dan Mihailă
Electronics
Speech Recognition and Synthesis
article

Cross-Lingual Speaker Diarization for Romanian Without Fine-Tuning: End-to-End MSDD Versus a Traditional Segmentation–Embedding–Clustering Pipeline

Remus-Dan Ungureanu, Dan Mihailă
article en

Abstract

Speaker diarization is a key component for multiple downstream speech technologies, including speech transcription, meeting analytics, and conversational understanding; however, Romanian lacks publicly established diarization resources and benchmarks. This paper evaluates cross-lingual transfer of diarization systems pretrained on predominantly English data, under a strict no-adaptation policy. We compare an end-to-end neural diarization approach (MSDD) and a traditional modular pipeline (segmentation + speaker embeddings + clustering), both used as is with pretrained components. To enable controlled analysis despite the lack of Romanian diarization datasets, we construct a synthetic Romanian conversational benchmark with explicit conditions on speaker count (2–5) and overlap regime (no overlap versus overlap). We report the diarization error rate (DER) and Jaccard error rate (JER) across all conditions, analyze sensitivity to overlap and the number of speakers, and provide an error-component breakdown to identify dominant failure modes. Across all conditions, the end-to-end system outperforms the pipeline (DER 0.140 versus 0.267; JER 0.152 versus 0.320). Performance degrades with overlap and with increasing speaker count in both paradigms, with speaker confusion dominating the additional error under overlap.

ElectronicsVol. 15(4)
Academia Oamenilor de Știință din România (RO), Universitatea Națională de Știință și Tehnologie Politehnica București (RO)
Openalex Percentile: Top 59%
Speech Recognition and Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.