The Improved Bi-LSTM-Transformer Model and its Application

As a popular machine learning algorithm, deep learning can be applied to a wide range of fields. In this paper, the LSTM model in deep learning, its extended Bi-LSTM model, the Transformer model for processing sequence data and the Bi-LSTM-Transformer combination model are selected to conduct research and analysis, and the time series data under the influence of multiple factors are compared and studied, and the aging data are listed to compare and verify the models, and the experimental results are collected. According to the advantages of the above model in dealing with time series data, the parameters of the model are continuously optimized. The comparison of the evaluation index results shows that the combined model has higher accuracy than the other three models in predicting data, and the goodness of fit of the model reaches 0.994, and MAPE is only 0.565%. This result shows that the Bi-LSTM-Transformer combined model has better prediction ability in fitting time series data under the influence of multiple factors.

Authors

Institutions

Publication Details

Published
2024-11-01
DOI
https://doi.org/10.1109/iccbd-ai65562.2024.00019
Citations
1
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Improved Bi-LSTM-Transformer Model and its Application

Zheng‐Yi Zhou, Tangsen Zhan
1 citations
Neural Networks and Applications
0.35
article

The Improved Bi-LSTM-Transformer Model and its Application

Zheng‐Yi Zhou, Tangsen Zhan
article en
1 citations

Abstract

As a popular machine learning algorithm, deep learning can be applied to a wide range of fields. In this paper, the LSTM model in deep learning, its extended Bi-LSTM model, the Transformer model for processing sequence data and the Bi-LSTM-Transformer combination model are selected to conduct research and analysis, and the time series data under the influence of multiple factors are compared and studied, and the aging data are listed to compare and verify the models, and the experimental results are collected. According to the advantages of the above model in dealing with time series data, the parameters of the model are continuously optimized. The comparison of the evaluation index results shows that the combined model has higher accuracy than the other three models in predicting data, and the goodness of fit of the model reaches 0.994, and MAPE is only 0.565%. This result shows that the Bi-LSTM-Transformer combined model has better prediction ability in fitting time series data under the influence of multiple factors.

Jingdezhen Ceramic Institute (CN)
Affordable and clean energy
Openalex Percentile: Top 29%
Neural Networks and Applications
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.