Query-by-Example Speech Search using Mamba and Random Offset Mixed Padding
State-of-the-art approaches to Query-by-Example speech search are usually based on acoustic word embedding (AWE), representing variable-length speech segments with fixed-dimensional vectors using metric learning. In this paper, we propose a novel AWE network based on Mamba, a new state space model architecture for information-dense data. In order to further mitigate the mismatch between the training phase and the testing phase of AWE-based models, we also propose a novel audio segment padding method used in the training phase, Random Offset Mixed Padding. Comparisons with the state-of-the-art methods show that our method, Mamba-based network together with Random Offset Mixed Padding, achieves the best performance with significantly fewer parameters. We also demonstrate that the proposed padding method can enhance the performance of AWE-based baseline models.
Authors
- Gaofeng Cheng
- Li Ta (ORCID: https://orcid.org/0000-0001-5431-9787)
- Yonghong Yan (ORCID: https://orcid.org/0000-0001-6907-5770)
- Qingwei Zhao (ORCID: https://orcid.org/0000-0001-9272-2614)
- Kaixin Yang (ORCID: https://orcid.org/0009-0008-5234-2316)
Institutions
- Chinese Academy of Sciences (CN)
- Institute of Acoustics (CN)
Publication Details
- Published
- 2024-11-07
- DOI
- https://doi.org/10.1109/iscslp63861.2024.10800523
- Primary Topic
- Speech Recognition and Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 0.00