Spoofed Speech Detection with a Focus on Speaker Embedding
Self-Supervised Learning (SSL) models excel as feature extractors in downstream speech tasks, including the increasingly crucial area of spoof speech detection due to the rise of audio deepfakes using Text-To-Speech (TTS) and Voice Conversion (VC) technologies. To address this issue, we propose a novel approach that relies on speaker embedding using a finetuned WavLM model with layer-wise attentive statistics pooling combined to a supervised contrastive learning and cross-entropy loss. Evaluation on Logical Access (LA) and DeepFake (DF) tasks on ASVspoof 2019 and 2021 highlights its potential in detecting audio deepfakes, with the contrastive loss producing more stable results among test sets.
Authors
- Philippe Martin (ORCID: https://orcid.org/0000-0002-6793-8760)
- Aghilas Sini (ORCID: https://orcid.org/0000-0001-6785-6936)
- Pierre-François Marteau
- Damien Lolive
- Hoan My Tran
- David Guennec
- Arnaud Delhay (ORCID: https://orcid.org/0000-0001-6795-7999)
Institutions
- Université de Bretagne Sud (FR)
- Institut de Recherche en Informatique et Systèmes Aléatoires (FR)
- Le Mans Université (FR)
- Université de Rennes (FR)
Publication Details
- Published
- 2024-09-01
- DOI
- https://doi.org/10.21437/interspeech.2024-481
- Citations
- 8
- Primary Topic
- Speech Recognition and Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 2.78