RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection

Fake artefacts for discriminating between bonafide and fake audio can exist in both short-and long-range segments.Therefore, combining local and global feature information can effectively discriminate between bonafide and fake audio.This paper proposes an end-to-end bidirectional state space model, named RawBMamba, to capture both short-and long-range discriminative information for audio deepfake detection.Specifically, we use sinc Layer and multiple convolutional layers to capture short-range features, and then design a bidirectional Mamba to address Mamba's unidirectional modelling problem and further capture long-range feature information.Moreover, we develop a bidirectional fusion module to integrate embeddings, enhancing audio context representation and combining shortand long-range information.The results show that our proposed RawBMamba achieves a 34.1% improvement over Rawformer on ATSVspoof2021 LA dataset, and demonstrates competitive performance on other datasets.Codes will be released on https://github.com/cyjie429/RawBMamba.

Authors

Publication Details

Published
2024-09-01
DOI
https://doi.org/10.21437/interspeech.2024-698
Citations
19
Primary Topic
Music and Audio Processing
Type
article
Field-Weighted Citation Impact
6.66

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection

Cunhang Fan, Xiaohui Zhang, Jiangyan Yi, Chenglong Wang et al.
19 citations
Music and Audio Processing
6.66
article

RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection

Cunhang Fan, Xiaohui Zhang, Jiangyan Yi, Chenglong Wang, Jianhua Tao, Zhao Lv, Yujie Chen, Jun Xue, Siding Zeng, Shunbo Dong
article en
19 citations

Abstract

Fake artefacts for discriminating between bonafide and fake audio can exist in both short-and long-range segments.Therefore, combining local and global feature information can effectively discriminate between bonafide and fake audio.This paper proposes an end-to-end bidirectional state space model, named RawBMamba, to capture both short-and long-range discriminative information for audio deepfake detection.Specifically, we use sinc Layer and multiple convolutional layers to capture short-range features, and then design a bidirectional Mamba to address Mamba's unidirectional modelling problem and further capture long-range feature information.Moreover, we develop a bidirectional fusion module to integrate embeddings, enhancing audio context representation and combining shortand long-range information.The results show that our proposed RawBMamba achieves a 34.1% improvement over Rawformer on ATSVspoof2021 LA dataset, and demonstrates competitive performance on other datasets.Codes will be released on https://github.com/cyjie429/RawBMamba.

National Natural Science Foundation of China
Openalex Percentile: Top 2%
Music and Audio Processing
6.66
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.