FRMAdam-iTransformer KAN: A Fractional Order RMS Momentum Adam Optimized iTransformer with KAN for EEG and ECG Prediction

Accurately predicting electrocardiogram (ECG) and electroencephalogram (EEG) signals holds significant clinical importance. Although the iTransformer model performs well in long-sequence predictions, it still faces challenges such as low computational efficiency and gradient explosion. To address these issues, this paper proposes a fractional order root mean square momentum adaptive moment estimation optimizer iTransformer model based on Kolmogorov Arnold (FRMAdam-iTransformer KAN). This model incorporates the Fractional Root Mean Square Momentum Adaptive Moment Estimation optimizer (FRMAdam) and replaces the fully connected output layer of the original iTransformer with a KAN structure to improve prediction accuracy. Experimental results on ECG and EEG datasets demonstrate that the FRMAdam-iTransformer KAN model achieves a Mean Squared Error (MSE) of 0.0004 and a Mean Absolute Error (MAE) of 0.0137, representing reductions of 76.47% and 59.59%, respectively, compared to the original iTransformer model.

Authors

Institutions

Publication Details

Published
2024-12-13
DOI
https://doi.org/10.1109/icnc64304.2024.10987614
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

FRMAdam-iTransformer KAN: A Fractional Order RMS Momentum Adam Optimized iTransformer with KAN for EEG and ECG Prediction

Jie‐Jie Chen, Xiangtian Zhou, Ping Jiang, Xinrui Zhang
Neural Networks and Applications
article

FRMAdam-iTransformer KAN: A Fractional Order RMS Momentum Adam Optimized iTransformer with KAN for EEG and ECG Prediction

Jie‐Jie Chen, Xiangtian Zhou, Ping Jiang, Xinrui Zhang
article en

Abstract

Accurately predicting electrocardiogram (ECG) and electroencephalogram (EEG) signals holds significant clinical importance. Although the iTransformer model performs well in long-sequence predictions, it still faces challenges such as low computational efficiency and gradient explosion. To address these issues, this paper proposes a fractional order root mean square momentum adaptive moment estimation optimizer iTransformer model based on Kolmogorov Arnold (FRMAdam-iTransformer KAN). This model incorporates the Fractional Root Mean Square Momentum Adaptive Moment Estimation optimizer (FRMAdam) and replaces the fully connected output layer of the original iTransformer with a KAN structure to improve prediction accuracy. Experimental results on ECG and EEG datasets demonstrate that the FRMAdam-iTransformer KAN model achieves a Mean Squared Error (MSE) of 0.0004 and a Mean Absolute Error (MAE) of 0.0137, representing reductions of 76.47% and 59.59%, respectively, compared to the original iTransformer model.

Hubei Polytechnic University (CN), Hubei Normal University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 73%
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.