Leveraging Neural Vocoder Artifacts for Improved Synthetic Speech Detection

With the advancement of deep learning, speech synthesis technology has improved significantly, but this progress also increases the risk of speech forgery.In this paper, we enhance synthetic speech detection by fully leveraging neural vocoder artifacts and improving feature representation.Our approach enhances the model's ability to detect synthetic speech by identifying artifacts produced by neural vocoder.We introduce the Enhanced Feature Extraction Module and the Dynamic Layer Attention Module to improve the model's feature representation and enhance its sensitivity to artifact features, significantly boosting the performance of synthetic speech detection.Additionally, we apply the exponential moving average (EMA) during training to further stabilize the model.Our experiments show that this method achieves an EER of 0.03% on the public datasets LibriSeVoc and 3.10% on the ASVspoof 2019 LA task.Compared to the LFCC-LCNN baseline, these results represent relative reductions of 78.6% and 73.3%, respectively.

Authors

Institutions

Publication Details

Published
2024-11-22
DOI
https://doi.org/10.1145/3725949.3725971
Citations
1
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Leveraging Neural Vocoder Artifacts for Improved Synthetic Speech Detection

W. Zhang, Sanshuai Cui, Jing-Bo Xue
1 citations
Speech Recognition and Synthesis
0.35
article

Leveraging Neural Vocoder Artifacts for Improved Synthetic Speech Detection

W. Zhang, Sanshuai Cui, Jing-Bo Xue
article en
1 citations

Abstract

With the advancement of deep learning, speech synthesis technology has improved significantly, but this progress also increases the risk of speech forgery.In this paper, we enhance synthetic speech detection by fully leveraging neural vocoder artifacts and improving feature representation.Our approach enhances the model's ability to detect synthetic speech by identifying artifacts produced by neural vocoder.We introduce the Enhanced Feature Extraction Module and the Dynamic Layer Attention Module to improve the model's feature representation and enhance its sensitivity to artifact features, significantly boosting the performance of synthetic speech detection.Additionally, we apply the exponential moving average (EMA) during training to further stabilize the model.Our experiments show that this method achieves an EER of 0.03% on the public datasets LibriSeVoc and 3.10% on the ASVspoof 2019 LA task.Compared to the LFCC-LCNN baseline, these results represent relative reductions of 78.6% and 73.3%, respectively.

City University of Macau (MO)
Quality Education
Openalex Percentile: Top 29%
Speech Recognition and Synthesis
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Leveraging Neural Vocoder Artifacts for Improved Synthetic Speech Detection — W. Zhang, Sanshuai Cui, et al. · (2024) | TGRS Research Map | TGRS