$\beta$-Order Energy-Weighting Modulation on Spectral Bins for Replay Speech Detection

The usage of recording and playback devices for the generation of replay speech introduces some variation into replay speech. This kind of variation penetrates into the shorttime details of the replay speech signal in a way of energy distribution. Together with the environmental noise during the process of recording, the disparity between replay speech and genuine speech is discernible. In this paper, in order to emphasize the disparity of the short-time energy distribution between replay speech and genuine speech, we propose a β-order energyweighting (EW) method to modulate the spectral-energy into spectral bins in short time frame-wise duration. Specifically, we apply the β-order EW modulation in different spectral domains, i.e., octave spectral domain, Mel spectral domain and linear spectral domain. Subsequently, we propose three novel features: constant-Q EW octave coefficient (CEOC), Mel frequency EW cepstral coefficient (MFECC), and linear frequency EW cepstral coefficient (LFECC). Moreover, with the three proposed features, relevant replay speech detection (RSD) systems are developed with respective ResNet and DNN as backend classifiers. With experiments conducted on respective ASVspoof 2017 version 2.0, BTAS 2016 physical access, ASVspoof 2019 physical access and ASVspoof 2021 physical access corpora, the effectiveness of the three proposed features is evaluated in terms of the RSD performance. The evaluation results demonstrate that the β-order EW modulation exhibits superior discriminative capability in detecting replay speech. Furthermore, through the experiments, it can be observed that our proposed RSD systems outperform many state-of-the-art RSD systems.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Audio Speech and Language Processing
Published
2025-01-01
DOI
https://doi.org/10.1109/taslpro.2025.3587454
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

$\beta$-Order Energy-Weighting Modulation on Spectral Bins for Replay Speech Detection

Jichen Yang, Chang Huai You, Rohan Kumar Das
1 links
IEEE Transactions on Audio Speech and Language Processing
Speech and Audio Processing
article

$\beta$-Order Energy-Weighting Modulation on Spectral Bins for Replay Speech Detection

Jichen Yang, Chang Huai You, Rohan Kumar Das
article en

Abstract

The usage of recording and playback devices for the generation of replay speech introduces some variation into replay speech. This kind of variation penetrates into the shorttime details of the replay speech signal in a way of energy distribution. Together with the environmental noise during the process of recording, the disparity between replay speech and genuine speech is discernible. In this paper, in order to emphasize the disparity of the short-time energy distribution between replay speech and genuine speech, we propose a β-order energyweighting (EW) method to modulate the spectral-energy into spectral bins in short time frame-wise duration. Specifically, we apply the β-order EW modulation in different spectral domains, i.e., octave spectral domain, Mel spectral domain and linear spectral domain. Subsequently, we propose three novel features: constant-Q EW octave coefficient (CEOC), Mel frequency EW cepstral coefficient (MFECC), and linear frequency EW cepstral coefficient (LFECC). Moreover, with the three proposed features, relevant replay speech detection (RSD) systems are developed with respective ResNet and DNN as backend classifiers. With experiments conducted on respective ASVspoof 2017 version 2.0, BTAS 2016 physical access, ASVspoof 2019 physical access and ASVspoof 2021 physical access corpora, the effectiveness of the three proposed features is evaluated in terms of the RSD performance. The evaluation results demonstrate that the β-order EW modulation exhibits superior discriminative capability in detecting replay speech. Furthermore, through the experiments, it can be observed that our proposed RSD systems outperform many state-of-the-art RSD systems.

IEEE Transactions on Audio Speech and Language ProcessingVol. 33
Agency for Science, Technology and Research (SG), Institute for Infocomm Research (SG), Guangdong Polytechnic Normal University (CN)
Openalex Percentile: Top 80%
Speech and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.