EEG-SKDNet: A Self-Knowledge Distillation Model With Scaled Weights for Emotion Recognition From EEG Signals

Electroencephalogram-based emotion recognition has garnered increasing attention due to its potential in human–computer interaction and affective computing. While recent deep learning methods have achieved remarkable performance in this task, most approaches emphasize accuracy at the expense of computational efficiency, making them impractical for real-time applications or deployment on resource-constrained devices. This paper addresses the critical challenge of achieving high-performance electroencephalography-based emotion recognition with low computational cost by introducing a lightweight yet robust learning strategy. In this paper, we propose a novel self-knowledge distillation framework that requires no teacher model. Unlike conventional knowledge distillation approaches that rely on large pre-trained teacher networks, our method leverages two different augmented views of the electroencephalography input, which are passed through a single student model to generate diverse predictions. These predictions are then used to transfer knowledge internally within the model. To enhance this self-distillation process, we introduce a scaled-weights mechanism that dynamically adjusts the contribution of each soft label based on the original input, allowing the model to focus on electroencephalography segments with more informative or high-intensity signal regions. The experiment results have shown that our proposed framework consistently outperforms the baseline and even state-of-the-art deep models, achieving a superior trade-off among performance, model size, computation cost and inference time. This makes our proposed framework highly suitable for deployment in real-time and edge-based emotion recognition applications.

Authors

Institutions

Publication Details

Journal
IEEE Access
Published
2025-01-01
DOI
https://doi.org/10.1109/access.2025.3594671
Citations
2
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
4.24
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

EEG-SKDNet: A Self-Knowledge Distillation Model With Scaled Weights for Emotion Recognition From EEG Signals

Duc-Quang Vu, Trung-Nghia Phung, Thuong Duong Thi, Huy Nguyen Phuong
2 citations
IEEE Access
Emotion and Mood Recognition
4.24
article

EEG-SKDNet: A Self-Knowledge Distillation Model With Scaled Weights for Emotion Recognition From EEG Signals

Duc-Quang Vu, Trung-Nghia Phung, Thuong Duong Thi, Huy Nguyen Phuong
article en
2 citations

Abstract

Electroencephalogram-based emotion recognition has garnered increasing attention due to its potential in human–computer interaction and affective computing. While recent deep learning methods have achieved remarkable performance in this task, most approaches emphasize accuracy at the expense of computational efficiency, making them impractical for real-time applications or deployment on resource-constrained devices. This paper addresses the critical challenge of achieving high-performance electroencephalography-based emotion recognition with low computational cost by introducing a lightweight yet robust learning strategy. In this paper, we propose a novel self-knowledge distillation framework that requires no teacher model. Unlike conventional knowledge distillation approaches that rely on large pre-trained teacher networks, our method leverages two different augmented views of the electroencephalography input, which are passed through a single student model to generate diverse predictions. These predictions are then used to transfer knowledge internally within the model. To enhance this self-distillation process, we introduce a scaled-weights mechanism that dynamically adjusts the contribution of each soft label based on the original input, allowing the model to focus on electroencephalography segments with more informative or high-intensity signal regions. The experiment results have shown that our proposed framework consistently outperforms the baseline and even state-of-the-art deep models, achieving a superior trade-off among performance, model size, computation cost and inference time. This makes our proposed framework highly suitable for deployment in real-time and edge-based emotion recognition applications.

IEEE AccessVol. 13
Thai Nguyen University (VN)
Openalex Percentile: Top 6%
Emotion and Mood Recognition
4.24
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.