AM-ConvBLS: Adaptive Manifold Convolutional Broad Learning System for Cross-Session and Cross-Subject Emotion Recognition

Emotion recognition based on electroencephalography (EEG) data has gained rapid development because of its believability and accuracy. However, most existing EEG emotion recognition methods suffer from three issues: 1) underutilization of multi-scale emotion representations, 2) underexploitation of emotion labels and intrinsic geometric structures, and 3) inherent non-stationarity characteristic and individual variability of EEG signals. To this end, we propose an Adaptive Manifold Convolutional Broad Learning System (AM-ConvBLS) to capture the multi-scale distribution aligned emotion patterns in the geometric structure preserved emotion submanifold space. To begin with, a Multi-Scale Representation Learning (MSRL) module is developed to learn diverse multi-scale emotion representations. The Domain Discrepancy Elimination (DDE) module is then developed to further align feature distributions in the source and target domains. To further utilize EEG emotion labels, we devise a Label Manifold Information Exploration (LMIE) module to retain the sample label consistency. In addition, a global feature importance analysis method for AM-ConvBLS based on Shapley Additive Global importancE (SAGE) is designed to investigate the EEG frequency band importance and brain neural activation patterns. Experiments on SEED, SEED-IV, and SEED-V datasets demonstrate the effectiveness and superiority of our AM-ConvBLS.