Influence of pitch modulation on event-related potentials elicited by Dutch word stimuli in a brain–computer interface language rehabilitation task

<i>Objective.</i>Recently, a novel language training using an auditory brain-computer interface (BCI) based on electroencephalogram recordings has been proposed for chronic stroke patients with aphasia. Tested with native German patients, it has shown significant and medium to large effect sizes in improving multiple aspects of language. During the training, the auditory BCI system delivers word stimuli using six spatially arranged loudspeakers. As delivering the word stimuli via headphones reduces spatial cues and makes the attention to target words more difficult, we investigate the influence of added pitch information. While pitch modulations have shown benefits for tone stimuli, they have not yet been investigated in the context of language stimuli.<i>Approach.</i>The study translated the German experimental setup into Dutch. Seventeen native Dutch speakers participated in a single session of an exploratory study. An incomplete Dutch sentence cued them to listen to a target word embedded into a sequence of comparable non-target words while an electroencephalogram was recorded. Four conditions were compared within-subject to investigate the influence of pitch modulation: presenting the words spatially from six loudspeakers without (<i>6D</i>) and with pitch modulation (<i>6D-Pitch</i>), via stereo headphones with simulated spatial cues and pitch modulation (<i>Stereo-Pitch</i>), and via headphones without spatial cues or pitch modulation (<i>Mono</i>).<i>Main results.</i>Comparing the 6D conditions of both language setups, the Dutch setup could be validated. For the Dutch setup, the binary AUC classification score in the 6D and the 6D-Pitch condition were 0.75 and 0.76, respectively, and adding pitch information did not significantly alter the binary classification accuracy of the event-related potential responses. The classification scores in the 6D condition and the Stereo-Pitch condition were on the same level.<i>Significance.</i>The competitive performance of pitch-modulated word stimuli suggests that the complex hardware setup of the 6D condition could be replaced by a headphone condition. If future studies with aphasia patients confirm the effectiveness and higher usability of a headphone-based language rehabilitation training, a simplified setup could be implemented more easily outside of clinics to deliver frequent training sessions to patients in need.

Authors

Institutions

Publication Details

Journal
Journal of Neural Engineering
Published
2025-04-02
DOI
https://doi.org/10.1088/1741-2552/adc83d
Primary Topic
EEG and Brain-Computer Interfaces
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Influence of pitch modulation on event-related potentials elicited by Dutch word stimuli in a brain–computer interface language rehabilitation task

Simon Kojima, Mariacristina Musso, Michael Tangermann, Rongkun Zheng et al.
Journal of Neural Engineering
EEG and Brain-Computer Interfaces
article

Influence of pitch modulation on event-related potentials elicited by Dutch word stimuli in a brain–computer interface language rehabilitation task

Simon Kojima, Mariacristina Musso, Michael Tangermann, Rongkun Zheng, Shin’ichiro Kanoh, Benjamin Eren Kortenbach, Crispijn Aalberts, Sara Miloševska, Kim de Wit
article en

Abstract

<i>Objective.</i>Recently, a novel language training using an auditory brain-computer interface (BCI) based on electroencephalogram recordings has been proposed for chronic stroke patients with aphasia. Tested with native German patients, it has shown significant and medium to large effect sizes in improving multiple aspects of language. During the training, the auditory BCI system delivers word stimuli using six spatially arranged loudspeakers. As delivering the word stimuli via headphones reduces spatial cues and makes the attention to target words more difficult, we investigate the influence of added pitch information. While pitch modulations have shown benefits for tone stimuli, they have not yet been investigated in the context of language stimuli.<i>Approach.</i>The study translated the German experimental setup into Dutch. Seventeen native Dutch speakers participated in a single session of an exploratory study. An incomplete Dutch sentence cued them to listen to a target word embedded into a sequence of comparable non-target words while an electroencephalogram was recorded. Four conditions were compared within-subject to investigate the influence of pitch modulation: presenting the words spatially from six loudspeakers without (<i>6D</i>) and with pitch modulation (<i>6D-Pitch</i>), via stereo headphones with simulated spatial cues and pitch modulation (<i>Stereo-Pitch</i>), and via headphones without spatial cues or pitch modulation (<i>Mono</i>).<i>Main results.</i>Comparing the 6D conditions of both language setups, the Dutch setup could be validated. For the Dutch setup, the binary AUC classification score in the 6D and the 6D-Pitch condition were 0.75 and 0.76, respectively, and adding pitch information did not significantly alter the binary classification accuracy of the event-related potential responses. The classification scores in the 6D condition and the Stereo-Pitch condition were on the same level.<i>Significance.</i>The competitive performance of pitch-modulated word stimuli suggests that the complex hardware setup of the 6D condition could be replaced by a headphone condition. If future studies with aphasia patients confirm the effectiveness and higher usability of a headphone-based language rehabilitation training, a simplified setup could be implemented more easily outside of clinics to deliver frequent training sessions to patients in need.

Journal of Neural EngineeringVol. 22(3)
Radboud University Nijmegen (NL), University of Freiburg (DE), Shibaura Institute of Technology (JP), Erasmus MC (NL), Brain (Germany) (DE), RIKEN Center for Advanced Intelligence Project (JP), Erasmus University Rotterdam (NL)
Nederlandse Organisatie voor Wetenschappelijk Onderzoek, Japan Society for the Promotion of Science
Quality Education
Openalex Percentile: Top 94%
EEG and Brain-Computer Interfaces
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.