LSTM Parameter Optimization Based on Improved Sparrow Search Algorithm and NSGAII

The Long Short-Term Memory (LSTM) network is a commonly used model for time series data. However, its model performance and generalization ability heavily depend on the parameter configuration. Therefore, it is necessary to study parameter optimization for the LSTM model. Sparrow Search Algorithm (SSA) holds advantages over the traditional optimization algorithms in several aspects. However, it still faces some challenges. Therefore, based on SSA, this paper introduces three strategies to improve it: Levy flight strategy, sine search strategy, and step size factor adjustment strategy. The resulting algorithm is called the Improved Sparrow Search Algorithm (ISSA). Then, we establish the ISSA-LSTM model. Additionally, to address the limitations of SSA in dealing with multi-objective problems, we introduce the Fast Non-dominated Sorting Genetic Algorithm (NSGAII) and establish the ISSA-NSGAII model. Finally, the experimental validation demonstrates the superiority of the proposed algorithm in optimizing parameters for the LSTM model.

Authors

Institutions

Publication Details

Published
2024-08-21
DOI
https://doi.org/10.1109/iai63275.2024.10730215
Citations
3
Primary Topic
Advanced Algorithms and Applications
Type
article
Field-Weighted Citation Impact
0.98

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LSTM Parameter Optimization Based on Improved Sparrow Search Algorithm and NSGAII

Ping Zhou, Ziwen Zhang, Ruiyao Zhang
3 citations
Advanced Algorithms and Applications
0.98
article

LSTM Parameter Optimization Based on Improved Sparrow Search Algorithm and NSGAII

Ping Zhou, Ziwen Zhang, Ruiyao Zhang
article en
3 citations

Abstract

The Long Short-Term Memory (LSTM) network is a commonly used model for time series data. However, its model performance and generalization ability heavily depend on the parameter configuration. Therefore, it is necessary to study parameter optimization for the LSTM model. Sparrow Search Algorithm (SSA) holds advantages over the traditional optimization algorithms in several aspects. However, it still faces some challenges. Therefore, based on SSA, this paper introduces three strategies to improve it: Levy flight strategy, sine search strategy, and step size factor adjustment strategy. The resulting algorithm is called the Improved Sparrow Search Algorithm (ISSA). Then, we establish the ISSA-LSTM model. Additionally, to address the limitations of SSA in dealing with multi-objective problems, we introduce the Fast Non-dominated Sorting Genetic Algorithm (NSGAII) and establish the ISSA-NSGAII model. Finally, the experimental validation demonstrates the superiority of the proposed algorithm in optimizing parameters for the LSTM model.

State Key Laboratory of Synthetical Automation for Process Industries, Northeastern University (CN)
National Natural Science Foundation of China, Higher Education Discipline Innovation Project
Openalex Percentile: Top 23%
Advanced Algorithms and Applications
0.98
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.