Decoding Cognitive States via Riemannian Geometry-Informed Channel Clustering for EEG Transformers

Electroencephalography (EEG) provides a non-invasive and high-temporal-resolution modality for decoding cognitive states, but high-density recordings remain challenging for Transformer-based models because self-attention scales quadratically with the number of channels. In addition, conventional Euclidean representations do not fully capture the intrinsic geometry of EEG covariance features, which may limit robustness in cross-subject settings. To address these issues, we propose EEG-RCformer, a Riemannian geometry-informed channel clustering Transformer for EEG decoding. The model first computes per-channel symmetric positive definite (SPD) covariance matrices from windowed EEG features and uses the affine-invariant Riemannian metric (AIRM) to identify trial-specific functional hubs. These hubs are then integrated with capacity-constrained spatial clustering to generate anatomically plausible and computationally efficient channel groups, which are encoded as tokens for a Transformer classifier. We evaluated EEG-RCformer on the MODMA and SEED datasets under both subject-dependent and -independent paradigms, achieving area under the curve (AUC) values of 0.9802 and 0.7154 on MODMA and 0.8541 and 0.8011 on SEED, respectively. Paired statistical tests further showed significant gains for MODMA in both the subject-dependent and -independent settings and for SEED in the subject-dependent setting, while SEED still showed a positive but non-significant mean improvement in the subject-independent setting.