Representation of Articulatory Features in EEG During Speech Production Tasks
Investigating the representation of various speech features in EEG signals is crucial for advancing non-invasive speech decoding. In this study, we compared the EEG representation of two commonly used speech features in speech decoding: articulatory and acoustic features. To achieve this, we collected EEG data from 8 Mandarin-speaking participants while they performed both overt speech and imagined speech tasks. Linear encoding and decoding models were constructed to bridge the connection between EEG signals and speech features. The decoding models for predicting articulatory features demonstrated a better representation of articulatory features in EEG compared to traditional acoustic features. Additionally, scalp topographies of entrainment strength obtained by encoding models revealed strong representation of articulatory features in electrodes of the parietal motor area. These findings will contribute to the further application of articulatory features in EEG-based neural speech decoding.
Authors
- Sinan Sun
- Longxiang Zhang
- Xihong Wu (ORCID: https://orcid.org/0009-0004-5236-7469)
- Jing Chen (ORCID: https://orcid.org/0000-0002-6640-7140)
- Bo Wang (ORCID: https://orcid.org/0000-0002-5596-1795)
Publication Details
- Published
- 2024-11-07
- DOI
- https://doi.org/10.1109/iscslp63861.2024.10800095
- Primary Topic
- Neural Networks and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00