Real-time decoding of full-spectrum Chinese using brain-computer interface
Speech brain-computer interfaces (BCIs) offer a promising means to provide functional communication capacity for patients with anarthria caused by neurological conditions such as amyotrophic lateral sclerosis (ALS) or brainstem stroke. Current speech decoding research has predominantly focused on English using phoneme-driven architectures, whereas real-time decoding of tonal monosyllabic languages such as Mandarin Chinese remains a major challenge. This study demonstrates a real-time Mandarin speech BCI that decodes monosyllabic units directly from neural signals. Using the 256-channel microelectrocorticographic BCI, we achieved robust decoding of a comprehensive set of 394 distinct syllables based purely on neural signals, yielding median syllable identification accuracy of 71.2% in a single-character reading task. Leveraging this high-performing syllable decoder, we further demonstrated real-time sentence decoding. Our findings demonstrate the efficacy of a tonally integrated, direct syllable neural decoding approach for Mandarin Chinese, paving the way for full-coverage systems in tonal monosyllabic languages.
Authors
- Zhitao Zhou (ORCID: https://orcid.org/0000-0003-4277-4461)
- Jinsong Wu (ORCID: https://orcid.org/0000-0001-7854-9798)
- Qinrong Yang (ORCID: https://orcid.org/0009-0008-3451-9026)
- Junfeng Lu (ORCID: https://orcid.org/0000-0002-6091-5742)
- Tiger H. Tao (ORCID: https://orcid.org/0000-0002-6583-5039)
- C. Liu (ORCID: https://orcid.org/0000-0003-3627-2334)
- Eyou Zhou (ORCID: https://orcid.org/0009-0009-8432-0928)
- Xingchen Ran (ORCID: https://orcid.org/0000-0002-3868-0713)
- Youkun Qian (ORCID: https://orcid.org/0000-0002-9984-4830)
- Yan Liu (ORCID: https://orcid.org/0000-0003-4242-4840)
- Yijie Wang (ORCID: https://orcid.org/0000-0002-2681-0138)
- Lei Xia (ORCID: https://orcid.org/0000-0001-9749-3435)
- Yuanning Li (ORCID: https://orcid.org/0000-0003-3277-0600)
- Shangcheng Li (ORCID: https://orcid.org/0009-0007-6371-4069)
- P.Y. Yu (ORCID: https://orcid.org/0009-0003-5938-8345)
- Ji Qi (ORCID: https://orcid.org/0009-0005-9708-6027)
Institutions
- Chinese Academy of Sciences (CN)
- Fudan University (CN)
- ShanghaiTech University (CN)
- Guangdong Polytechnic of Science and Technology (CN)
- State Key Laboratory of Transducer Technology (CN)
- Shanghai Chengtou (China) (CN)
- Shanghai Institute of Microsystem and Information Technology (CN)
- Shanghai Clinical Research Center (CN)
- Huashan Hospital (CN)
- University of Chinese Academy of Sciences (CN)
Publication Details
- Journal
- Science Advances
- Published
- 2025-11-05
- DOI
- https://doi.org/10.1126/sciadv.adz9968
- Citations
- 4
- Primary Topic
- EEG and Brain-Computer Interfaces
- Type
- article
- Field-Weighted Citation Impact
- 5.72