Research on Robot Path Planning Based on Deep Reinforcement Learning with Big Data

Path planning is a core technology for mobile robots to achieve autonomous navigation and intelligent operations. Against the backdrop of the development of intelligent robotics, traditional path planning algorithms, such as A* algorithm, artificial potential field method, and bionic algorithms, have limitations in handling complex environments. Reinforcement learning, especially Q-learning and its improved algorithms, offers new solutions for path planning. However, traditional Q-learning faces challenges like the curse of dimensionality, and DQN has the problem of overestimation. This paper proposes a robot path planning method based on Deep Double Q-Learning (DDQN). It constructs a Q-value function approximation model using a deep neural network, avoiding the curse of dimensionality through large-scale data-driven end-to-end training. The DDQN algorithm is adopted to alleviate the overestimation issue, and a re-replay mechanism is proposed to improve convergence. Additionally, the Bézier curve is used to smooth the planned path. Simulation experiments in a 40×40 grid map environment show that compared with the traditional Q-learning algorithm, the proposed algorithm shortens the average path length by 32.5%, reduces the number of turning points by 42.9%, decreases the average curvature fluctuation value, and increases the convergence speed by 57.1%, demonstrating higher adaptability and efficiency in robot path planning.

Authors

Institutions

Publication Details

Published
2025-05-23
DOI
https://doi.org/10.1109/icetci64844.2025.11084170
Primary Topic
E-commerce and Technology Innovations
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on Robot Path Planning Based on Deep Reinforcement Learning with Big Data

Yu‐Sun Chang, C.S. Li, Yujie Wang, Jin Lu
E-commerce and Technology Innovations
article

Research on Robot Path Planning Based on Deep Reinforcement Learning with Big Data

Yu‐Sun Chang, C.S. Li, Yujie Wang, Jin Lu
article en

Abstract

Path planning is a core technology for mobile robots to achieve autonomous navigation and intelligent operations. Against the backdrop of the development of intelligent robotics, traditional path planning algorithms, such as A* algorithm, artificial potential field method, and bionic algorithms, have limitations in handling complex environments. Reinforcement learning, especially Q-learning and its improved algorithms, offers new solutions for path planning. However, traditional Q-learning faces challenges like the curse of dimensionality, and DQN has the problem of overestimation. This paper proposes a robot path planning method based on Deep Double Q-Learning (DDQN). It constructs a Q-value function approximation model using a deep neural network, avoiding the curse of dimensionality through large-scale data-driven end-to-end training. The DDQN algorithm is adopted to alleviate the overestimation issue, and a re-replay mechanism is proposed to improve convergence. Additionally, the Bézier curve is used to smooth the planned path. Simulation experiments in a 40×40 grid map environment show that compared with the traditional Q-learning algorithm, the proposed algorithm shortens the average path length by 32.5%, reduces the number of turning points by 42.9%, decreases the average curvature fluctuation value, and increases the convergence speed by 57.1%, demonstrating higher adaptability and efficiency in robot path planning.

Shenyang Ligong University (CN), Minzu University of China (CN), Jining Normal University (CN), Heilongjiang Vocational College of Art (CN), Heilongjiang Institute of Technology (CN)
Openalex Percentile: Top 67%
E-commerce and Technology Innovations
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Research on Robot Path Planning Based on Deep Reinforcement Learning with Big Data — Yu‐Sun Chang, C.S. Li, et al. · (2025) | TGRS Research Map | TGRS