FRMAdam-iTransformer KAN: A Fractional Order RMS Momentum Adam Optimized iTransformer with KAN for EEG and ECG Prediction
Accurately predicting electrocardiogram (ECG) and electroencephalogram (EEG) signals holds significant clinical importance. Although the iTransformer model performs well in long-sequence predictions, it still faces challenges such as low computational efficiency and gradient explosion. To address these issues, this paper proposes a fractional order root mean square momentum adaptive moment estimation optimizer iTransformer model based on Kolmogorov Arnold (FRMAdam-iTransformer KAN). This model incorporates the Fractional Root Mean Square Momentum Adaptive Moment Estimation optimizer (FRMAdam) and replaces the fully connected output layer of the original iTransformer with a KAN structure to improve prediction accuracy. Experimental results on ECG and EEG datasets demonstrate that the FRMAdam-iTransformer KAN model achieves a Mean Squared Error (MSE) of 0.0004 and a Mean Absolute Error (MAE) of 0.0137, representing reductions of 76.47% and 59.59%, respectively, compared to the original iTransformer model.
Authors
- Jie‐Jie Chen (ORCID: https://orcid.org/0000-0002-2539-8305)
- Xiangtian Zhou (ORCID: https://orcid.org/0000-0002-1115-561X)
- Ping Jiang (ORCID: https://orcid.org/0000-0001-8820-489X)
- Xinrui Zhang (ORCID: https://orcid.org/0009-0000-4722-8350)
Institutions
- Hubei Polytechnic University (CN)
- Hubei Normal University (CN)
Publication Details
- Published
- 2024-12-13
- DOI
- https://doi.org/10.1109/icnc64304.2024.10987614
- Primary Topic
- Neural Networks and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China