An Improvement of Q-Learning Based on Attenuation Oscillation Curve for Path Planning
Reinforcement Learning can be applied to many fields, but it is still a problem how to balance exploration and ex-ploitation it reasonably in the strategy of action selection. In order to solve the problem of path optimization in unknown environ-ment, a model based on Q-Learning algorithm is proposed to bal-ance the exploration stage and the exploitation stage. In this paper, based on Q-Learning algorithm, attenuation oscillation curve combined with it. The algorithm can reasonably adjust the time allocation of exploration stage and exploitation stage according to the current iteration times and iteration states. Effectively avoid the problem of over- exploitation and over-exploration of algorithms. In the path optimization simulation experiment, Q-Learning algorithm based on oscillation attenuation is compared with classical Q-Learning algorithm. Experiments show that for the same environment full of obstacles, Q-Learning algorithm based on oscillation attenuation can carry out path planning with better number of steps in a shorter search time, and has the ability to jump out of the local optimal.
Authors
- Yi Zuo (ORCID: https://orcid.org/0000-0002-4580-6855)
- Yuzhou Lu
- Wei Wu (ORCID: https://orcid.org/0000-0002-9624-2949)
- Shiwen Sheng
Institutions
- Liaoning University of Technology (CN)
- Dalian Maritime University (CN)
Publication Details
- Published
- 2024-12-06
- DOI
- https://doi.org/10.1109/icist63249.2024.10805292
- Primary Topic
- Robotic Path Planning Algorithms
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Liaoning Revitalization Talents Program