Convolutional Transformer-Based Cross Subject Model for SSVEP-Based BCI Classification
Steady-state visual evoked potential (SSVEP) is a commonly used brain-computer interface (BCI) paradigm. The performance of cross-subject SSVEP classification has a strong impact on SSVEP-BCI. This study designed a cross subject generalization SSVEP classification model based on an improved transformer structure that uses domain generalization (DG). The global receptive field of multi-head self-attention is used to learn the global generalized SSVEP temporal information across subjects. This is combined with a parallel local convolution module, designed to avoid oversmoothing the oscillation characteristics of temporal SSVEP data and better fit the feature. Moreover, to improve the cross-subject calibration-free SSVEP classification performance, an DG method named StableNet is combined with the proposed convolutional transformer structure to form the DG-Conformer method, which can eliminate spurious correlations between SSVEP discriminative information and background noise to improve cross-subject generalization. Experiments on two public datasets, Benchmark and BETA, demonstrated the outstanding performance of the proposed DG-Conformer compared with other calibration-free methods, FBCCA, tt-CCA, Compact-CNN, FB-tCNN, and SSVEPNet. Additionally, DG-Conformer outperforms the classic calibration-required algorithms eCCA, eTRCA and eSSCOR when calibration is used. An incomplete partial stimulus calibration scheme was also explored on the Benchmark dataset, and it was demonstrated to be a potential solution for further high-performance personalized SSVEP-BCI with quick calibration.
Authors
- Yuan Zong (ORCID: https://orcid.org/0000-0002-0839-8792)
- Wenming Zheng (ORCID: https://orcid.org/0000-0002-7764-5179)
- Sheng Ge (ORCID: https://orcid.org/0000-0001-6152-1318)
- Jiawei Liu (ORCID: https://orcid.org/0000-0002-0146-4363)
- Yue Leng (ORCID: https://orcid.org/0000-0001-9178-3837)
- Ruimin Wang (ORCID: https://orcid.org/0000-0002-1133-2698)
- Yuankui Yang
Institutions
- Saga University (JP)
- Southeast University (CN)
Publication Details
- Journal
- IEEE Journal of Biomedical and Health Informatics
- Published
- 2024-09-03
- DOI
- https://doi.org/10.1109/jbhi.2024.3454158
- Citations
- 18
- Primary Topic
- EEG and Brain-Computer Interfaces
- Type
- article
- Field-Weighted Citation Impact
- 6.17
Funders
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities