A Comparative Study of Acoustic Features for EMG-to-Speech Conversion in Low-Source Dataset
Electromyography (EMG) to audible speech conversions can help individuals with speech disabilities regain their ability to communicate. However, collecting large-scale EMG datasets can be challenging and cumbersome, posing a burden on users. Training a silent speech conversion model that performs well on low-resource datasets remains a challenge. One potential solution is to use acoustic features extracted from more efficient pre-trained models as the target features for prediction. This paper investigates the effects of content features from different pre-trained acoustic models and compare with commonly used MFCCs features in previous studies, exploring their impact in intelligibility, prosody, and conversion similarity.
Authors
- Longhan Xie (ORCID: https://orcid.org/0000-0002-5137-1413)
- Yang Liu (ORCID: https://orcid.org/0000-0003-2157-0080)
- Beichen Zhu (ORCID: https://orcid.org/0009-0002-6922-9674)
- Xianzhang Zeng (ORCID: https://orcid.org/0009-0005-5048-7464)
Institutions
- South China University of Technology (CN)
Publication Details
- Published
- 2024-12-06
- DOI
- https://doi.org/10.1109/iaecst64597.2024.11117914
- Primary Topic
- Speech and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- National Key Research and Development Program of China
- Basic and Applied Basic Research Foundation of Guangdong Province