A Skip Connection Generative Adversarial Network With EEG Background Noise for Motor Imagery Decoding

EEG decoding is a key for motor imagery-based brain-computer interfaces (MI-BCIs) to decode people’s motor intentions, holding a broad potential in medical rehabilitation. However, the amount of MI EEG data is often small because of some practical EEG collection limitations, which decreases the EEG decoding performance. This study proposes a skip connection generative adversarial network (GAN)-based data augmentation model to generate MI EEG samples, to expand the amount of the samples for the EEG decoding. The SGD utilizes independent component analysis (ICAs) to extract EEG background noise and to retain more biological information for the GAN and then employs a skip connection and multihead attention to integrate high- and low-level EEG features in the generator. Subsequently, the SGD adopts a temporal convolutional network (TCN) to discriminate between samples. The brain-computer interface (BCI) Competition IV-2a dataset is used to validate the SGD on four-class MI EEG decoding. The results show that the SGD can retain high accuracies (best accuracy: 86.15%, <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$p =0.034$ </tex-math></inline-formula>) under different ratios of generated MI EEG samples, implying that the skip connection and multihead attention are helpful for reconstructing the temporal and spatial features of MI EEG by ablation experiment. This study demonstrates the feasibility of applying EEG background noise to generate MI EEG samples, providing a new way to solve the small sample problem faced by the MI-BCI.