A Multidomain Coupled Spatiotemporal Feature Interaction Model for EEG Emotion Recognition

Electroencephalogram (EEG) is a powerful tool for monitoring the brain’s electrical activity, providing valuable insights into an individual’s emotional state. The task of emotion recognition from EEG signals has gained significant attention, particularly with the advent of deep learning techniques. However, challenges such as the inherent instability of EEG signals and insufficient feature extraction methods can hinder effective recognition. In this study, we propose a novel approach for EEG emotion recognition—the Multi-Domain Coupled Spatio-Temporal Feature Interaction Model (MCSFIM). First, leveraging the energy aggregation characteristics of the Fractional Fourier Transform (FrFT), we extract the features of the EEG signal fractional power spectral density (FrPSD) from multi-domain to address the non-stationarity of EEG signals and construct a more comprehensive feature set. Then, by integrating Graph Convolutional Networks (GCN) and Bidirectional Long-Short-Term Memory (BiLSTM) networks, we capture the spatial topology and temporal dependencies of EEG signals for feature interaction and classification. To further enhance classification accuracy, we propose a Dynamically Weighted Loss (DWL) function to reduce inter-class imbalance and achieve more precise emotion recognition. Extensive experimental results on the DEAP and SEED datasets demonstrate that the proposed method outperforms other state-of-the-art methods.