Robust audio deepfake detection: exploring front-/back-end combinations and data augmentation strategies for the ASVspoof5 Challenge

The robustness and generalizability of audio deepfake detectors are becoming more important due to the technical advances in generation methods and the widespread usage of audio deepfakes.The ASVspoof5 challenge addresses this by providing a new dataset.This paper presents Fraunhofer SIT's anti-spoofing detectors submitted to the ASVspoof5 challenge.AASIST(-L), RawGAT-ST and data augmentation was used in the closed condition.In the open condition, we evaluated different SSL-based front-ends using diverse training data.The results indicate that the utilisation of extensive data augmentation improve the results when using a non SSL-based front-end, whereas its incorporation with an SSL-based front-end led to a decline in performance.The implementation of a large SSL front-end improved the result.Our best detector in the closed setting attained a min DCF of 0.589 and the best in the open condition (using SSL) a min DCF of 0.174 on the ASVspoof5 evaluation set.

Authors

Publication Details

Published
2024-08-31
DOI
https://doi.org/10.21437/asvspoof.2024-9
Citations
3
Primary Topic
Music and Audio Processing
Type
article
Field-Weighted Citation Impact
1.05
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Robust audio deepfake detection: exploring front-/back-end combinations and data augmentation strategies for the ASVspoof5 Challenge

Karla Schäfer, Jeongeun Choi, Matthias Neu
3 citations
Music and Audio Processing
1.05
article

Robust audio deepfake detection: exploring front-/back-end combinations and data augmentation strategies for the ASVspoof5 Challenge

Karla Schäfer, Jeongeun Choi, Matthias Neu
article en
3 citations

Abstract

The robustness and generalizability of audio deepfake detectors are becoming more important due to the technical advances in generation methods and the widespread usage of audio deepfakes.The ASVspoof5 challenge addresses this by providing a new dataset.This paper presents Fraunhofer SIT's anti-spoofing detectors submitted to the ASVspoof5 challenge.AASIST(-L), RawGAT-ST and data augmentation was used in the closed condition.In the open condition, we evaluated different SSL-based front-ends using diverse training data.The results indicate that the utilisation of extensive data augmentation improve the results when using a non SSL-based front-end, whereas its incorporation with an SSL-based front-end led to a decline in performance.The implementation of a large SSL front-end improved the result.Our best detector in the closed setting attained a min DCF of 0.589 and the best in the open condition (using SSL) a min DCF of 0.174 on the ASVspoof5 evaluation set.

Openalex Percentile: Top 22%
Music and Audio Processing
1.05
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.