Hybrid Deep Learning Model Based on Transformer Encoder for Sleep Stages Classification

Sleep is the cornerstone of overall health, and the process of sleep staging involves classifying sleep data into specific stages. Key signals such as EEG, EOG, and EMG are useful in analysing and categorizing sleep data, but it is a complex and time-consuming task. This paper focuses on designing a hybrid deep learning model to accurately classify sleep data using the Sleep Heart Study (SHHS) dataset. Considering that sleep signals show similar temporal patterns to the time series data, we also use transform encoders to extract essential features and facilitate the discrimination of sleep stages. By leveraging the power of transform encoders to capture crucial temporal patterns, we have successfully enhanced the classification of sleep data into five stages. Through comprehensive evaluation using various criteria, we measure the performance of our model and compare it with cutting-edge methods. The results show a significant accuracy of 0.883 and 0.836 for accuracy and Cohen's kappa, respectively, confirming the effectiveness of our approach. The results also highlight the robustness and efficiency of our approach in accurately diagnosing sleep states, ultimately contributing to the advancement of sleep analysis and overall health monitoring.

Authors

Institutions

Publication Details

Journal
Bilad Alrafidain Journal for Engineering Science and Technology
Published
2025-03-15
DOI
https://doi.org/10.56990/bajest/2025.040110
Primary Topic
EEG and Brain-Computer Interfaces
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Hybrid Deep Learning Model Based on Transformer Encoder for Sleep Stages Classification

Omer Abd AL-Sattar Mohammed AL-AKKAM
Bilad Alrafidain Journal for Engineering Science and Technology
EEG and Brain-Computer Interfaces
article

Hybrid Deep Learning Model Based on Transformer Encoder for Sleep Stages Classification

Omer Abd AL-Sattar Mohammed AL-AKKAM
article en

Abstract

Sleep is the cornerstone of overall health, and the process of sleep staging involves classifying sleep data into specific stages. Key signals such as EEG, EOG, and EMG are useful in analysing and categorizing sleep data, but it is a complex and time-consuming task. This paper focuses on designing a hybrid deep learning model to accurately classify sleep data using the Sleep Heart Study (SHHS) dataset. Considering that sleep signals show similar temporal patterns to the time series data, we also use transform encoders to extract essential features and facilitate the discrimination of sleep stages. By leveraging the power of transform encoders to capture crucial temporal patterns, we have successfully enhanced the classification of sleep data into five stages. Through comprehensive evaluation using various criteria, we measure the performance of our model and compare it with cutting-edge methods. The results show a significant accuracy of 0.883 and 0.836 for accuracy and Cohen's kappa, respectively, confirming the effectiveness of our approach. The results also highlight the robustness and efficiency of our approach in accurately diagnosing sleep states, ultimately contributing to the advancement of sleep analysis and overall health monitoring.

Bilad Alrafidain Journal for Engineering Science and TechnologyVol. 4(1)
Islamic Azad University, Isfahan (IR)
Openalex Percentile: Top 94%
EEG and Brain-Computer Interfaces
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.