An Improvement of Q-Learning Based on Attenuation Oscillation Curve for Path Planning

Reinforcement Learning can be applied to many fields, but it is still a problem how to balance exploration and ex-ploitation it reasonably in the strategy of action selection. In order to solve the problem of path optimization in unknown environ-ment, a model based on Q-Learning algorithm is proposed to bal-ance the exploration stage and the exploitation stage. In this paper, based on Q-Learning algorithm, attenuation oscillation curve combined with it. The algorithm can reasonably adjust the time allocation of exploration stage and exploitation stage according to the current iteration times and iteration states. Effectively avoid the problem of over- exploitation and over-exploration of algorithms. In the path optimization simulation experiment, Q-Learning algorithm based on oscillation attenuation is compared with classical Q-Learning algorithm. Experiments show that for the same environment full of obstacles, Q-Learning algorithm based on oscillation attenuation can carry out path planning with better number of steps in a shorter search time, and has the ability to jump out of the local optimal.

Authors

Institutions

Publication Details

Published
2024-12-06
DOI
https://doi.org/10.1109/icist63249.2024.10805292
Primary Topic
Robotic Path Planning Algorithms
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Improvement of Q-Learning Based on Attenuation Oscillation Curve for Path Planning

Yi Zuo, Yuzhou Lu, Wei Wu, Shiwen Sheng
Robotic Path Planning Algorithms
article

An Improvement of Q-Learning Based on Attenuation Oscillation Curve for Path Planning

Yi Zuo, Yuzhou Lu, Wei Wu, Shiwen Sheng
article en

Abstract

Reinforcement Learning can be applied to many fields, but it is still a problem how to balance exploration and ex-ploitation it reasonably in the strategy of action selection. In order to solve the problem of path optimization in unknown environ-ment, a model based on Q-Learning algorithm is proposed to bal-ance the exploration stage and the exploitation stage. In this paper, based on Q-Learning algorithm, attenuation oscillation curve combined with it. The algorithm can reasonably adjust the time allocation of exploration stage and exploitation stage according to the current iteration times and iteration states. Effectively avoid the problem of over- exploitation and over-exploration of algorithms. In the path optimization simulation experiment, Q-Learning algorithm based on oscillation attenuation is compared with classical Q-Learning algorithm. Experiments show that for the same environment full of obstacles, Q-Learning algorithm based on oscillation attenuation can carry out path planning with better number of steps in a shorter search time, and has the ability to jump out of the local optimal.

Liaoning University of Technology (CN), Dalian Maritime University (CN)
National Natural Science Foundation of China, Liaoning Revitalization Talents Program
Climate action
Openalex Percentile: Top 76%
Robotic Path Planning Algorithms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.