A Dual-path Conformer-Based Network for Neural Speech Coding
In this paper, we propose a neural speech coding method based on the dual-path conformer, which mainly consists of three steps: (1) the encoding and decoding of the time-frequency spectrum are performed by a structure that combines the CNN and the dual-path conformer, (2) residual vector quantization is employed to quantize the output features of encoder and form a compact discrete representation, and (3) multi-period and multi-scale discriminators are used to improve the perceptual quality of speech during adversarial training. Experimental results, from both subjective and objective evaluations, demonstrate that the proposed codec outperforms the state-of-the-art neural codec AudioDEC and the leading conventional codec Opus in terms of performance.
Authors
- Maoshen Jia (ORCID: https://orcid.org/0000-0002-3452-3913)
- Jiawei Ru
- Yuhao Zhao (ORCID: https://orcid.org/0009-0003-9105-8258)
- Liang Tao (ORCID: https://orcid.org/0000-0001-8553-8421)
Institutions
- Beijing University of Technology (CN)
Publication Details
- Published
- 2024-11-07
- DOI
- https://doi.org/10.1109/iscslp63861.2024.10800720
- Primary Topic
- Speech and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 0.00