A Spoofing Speech Detection Method Combining Multi-Scale Features and Cross-Layer Information
Pre-trained self-supervised speech models can extract general acoustic features, providing feature inputs for various speech downstream tasks. Spoofing speech detection, which is a pressing issue in the age of generative AI, requires both global information and local features of speech. The multi-layer transformer structure in pre-trained speech models can effectively capture temporal information and global context in speech, but there is still room for improvement in handling local features. To address this issue, a speech spoofing detection method that integrates multi-scale features and cross-layer information is proposed. The method introduces a multi-scale feature adapter (MSFA), which enhances the model’s ability to perceive local features through residual convolutional blocks and squeeze-and-excitation (SE) mechanisms. Additionally, cross-adaptable weights (CAWs) are used to guide the model in focusing on task-relevant shallow information, thereby enabling the effective fusion of features from different layers of the pre-trained model. Experimental results show that the proposed method achieved an equal error rate (EER) of 0.36% and 4.29% on the ASVspoof2019 logical access (LA) and ASVspoof2021 LA datasets, respectively, demonstrating excellent detection performance and generalization ability.
Authors
- Xianrong Zheng (ORCID: https://orcid.org/0000-0003-2695-9642)
- Baoning Niu (ORCID: https://orcid.org/0000-0002-7924-3384)
- Linjuan Zhang (ORCID: https://orcid.org/0000-0003-4704-5807)
- Hongyan Yuan (ORCID: https://orcid.org/0000-0001-8225-0211)
Institutions
- Decision Sciences (United States) (US)
- Old Dominion University (US)
- Taiyuan University of Technology (CN)
Publication Details
- Journal
- Information
- Published
- 2025-03-02
- DOI
- https://doi.org/10.3390/info16030194
- Primary Topic
- Speech and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 0.00