Improved DQN-based Robot Path Planning Algorithm for Mobile Robots

To resolve the challenge of sluggish convergence and suboptimal path quality in the deep Q-learning algorithm for path planning, this study investigates a robot path planning algorithm based on the Deep Q-Network (DQN) algorithm. Initially, The conventional artificial potential field approach is improved through eliminating the repulsive force and incorporating the map size within the gravitational field. A gravitational threshold is introduced to balance the effects of obstacle avoidance and goal attraction. To circumvent local minima, the improved APF is integrated with a stochastic exploration strategy, thereby accelerating convergence. Subsequently, the reward mechanism is refined by incorporating a distance-based reward between the intelligent agent and the target point. Finally, redundant nodes are eliminated by assessing the spatial relationship between paths and obstacles, and path smoothing is achieved using Bezier curves to enhance path quality. Simulation experiments conducted in a 10×10 grid environment using MATLAB demonstrate that the enhanced DQN algorithm reduces path length by 26% and increases convergence speed by 64%.

Institutions

Publication Details

Published
2025-05-17
DOI
https://doi.org/10.1109/yac66630.2025.11150283
Primary Topic
Research, Science, and Academia
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Improved DQN-based Robot Path Planning Algorithm for Mobile Robots

Research, Science, and Academia
article

Improved DQN-based Robot Path Planning Algorithm for Mobile Robots

article en

Abstract

To resolve the challenge of sluggish convergence and suboptimal path quality in the deep Q-learning algorithm for path planning, this study investigates a robot path planning algorithm based on the Deep Q-Network (DQN) algorithm. Initially, The conventional artificial potential field approach is improved through eliminating the repulsive force and incorporating the map size within the gravitational field. A gravitational threshold is introduced to balance the effects of obstacle avoidance and goal attraction. To circumvent local minima, the improved APF is integrated with a stochastic exploration strategy, thereby accelerating convergence. Subsequently, the reward mechanism is refined by incorporating a distance-based reward between the intelligent agent and the target point. Finally, redundant nodes are eliminated by assessing the spatial relationship between paths and obstacles, and path smoothing is achieved using Bezier curves to enhance path quality. Simulation experiments conducted in a 10×10 grid environment using MATLAB demonstrate that the enhanced DQN algorithm reduces path length by 26% and increases convergence speed by 64%.

PLA Information Engineering University (CN), Zhengzhou University (CN)
Openalex Percentile: Top 30%
Research, Science, and Academia
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.