Comprehensive benchmarking and explainable machine learning analysis of EEG imagery activity recognition

Motor imagery (MI)-based brain-computer interfaces (BCIs) enable users to control external devices using EEG signals, offering great potential in assistive and rehabilitation technologies. However, MI recognition remains challenging due to EEG's low signal-to-noise ratio (SNR), inter-subject variability, and complex spatiotemporal patterns. Existing approaches often suffer from limited accuracy, high computational cost, and poor interpretability. In response to these challenges, we present the first comprehensive benchmarking of the publicly available EEG-hand movement (EEG-HM) dataset. Our study aims to establish a standardized performance baseline, guide the selection of optimal models by jointly considering accuracy, prediction time, and explainability, and ultimately accelerate progress in MI-BCI development. We have proposed a two-stage optimization of machine learning models that employs both feature selection and hyperparameter tuning. We exploit five feature selection algorithms for selecting the best set of EEG electrodes and frequency bands, while Bayesian optimization is exploited for machine learning model optimization through hyperparameter tuning. Furthermore, to validate the neurophysiological basis of our model's decisions, we leverage explainable AI (XAI) algorithms-LIME and SHAP-quantifying the contributions of specific EEG electrodes and frequency bands to interpret its decision-making process. Through extensive simulations, the proposed two-stage optimization of the machine learning model demonstrates a superior performance in terms of accuracy, precision, and recall. This method outperforms the existing methods by 21.47% in accuracy with competitive prediction time. Its performance is further evaluated on the PhysioNet MI dataset, achieving a 4.67% accuracy improvement over state-of-the-art methods. Through LIME and SHAP, we provide the local and global explanations for no activity, left-hand, and right-hand imagery movements. Additionally, we analyze how various EEG frequency bands and electrode locations interact during the performance of different motor imagery hand movements.