RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection
Fake artefacts for discriminating between bonafide and fake audio can exist in both short-and long-range segments.Therefore, combining local and global feature information can effectively discriminate between bonafide and fake audio.This paper proposes an end-to-end bidirectional state space model, named RawBMamba, to capture both short-and long-range discriminative information for audio deepfake detection.Specifically, we use sinc Layer and multiple convolutional layers to capture short-range features, and then design a bidirectional Mamba to address Mamba's unidirectional modelling problem and further capture long-range feature information.Moreover, we develop a bidirectional fusion module to integrate embeddings, enhancing audio context representation and combining shortand long-range information.The results show that our proposed RawBMamba achieves a 34.1% improvement over Rawformer on ATSVspoof2021 LA dataset, and demonstrates competitive performance on other datasets.Codes will be released on https://github.com/cyjie429/RawBMamba.
Authors
- Cunhang Fan (ORCID: https://orcid.org/0000-0001-6318-8803)
- Xiaohui Zhang
- Jiangyan Yi (ORCID: https://orcid.org/0000-0003-2422-4618)
- Chenglong Wang (ORCID: https://orcid.org/0000-0002-6840-9529)
- Jianhua Tao (ORCID: https://orcid.org/0000-0002-0477-587X)
- Zhao Lv
- Yujie Chen (ORCID: https://orcid.org/0000-0002-0482-2496)
- Jun Xue
- Siding Zeng
- Shunbo Dong
Publication Details
- Published
- 2024-09-01
- DOI
- https://doi.org/10.21437/interspeech.2024-698
- Citations
- 19
- Primary Topic
- Music and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 6.66
Funders
- National Natural Science Foundation of China