An Adaptive Reinforcement Learning Path Planning Method for Indoor Complex Dynamic Environments

Path planning in indoor complex dynamic environments faces challenges such as frequent obstacle movements, high environmental uncertainty, and difficulty for agents to achieve stable convergence. Existing algorithms have limitations in adaptability, convergence speed, and path quality. To address these issues, this paper proposes an Adaptive Prioritized Experience Double Deep Q-Network Path Optimization method (APE-DPO), which integrates dynamic perturbation optimization, adaptive exploration rate adjustment, and a prioritized experience replay mechanism to enhance the agent's respon-siveness to dynamic environments and improve policy stability. Experiments conducted in three representative dynamic sce-narios-home, restaurant, and library-demonstrate that APE- DPO outperforms representative reinforcement learning models in the path planning domain, including DQN, DDQN, and their variants, in terms of path length, success rate, and convergence speed. In some scenarios, path length is reduced by 6.9% to 12.5%, showing strong robustness and practical application potential.

Authors

Institutions

Publication Details

Published
2025-08-10
DOI
https://doi.org/10.1109/wrcsara68202.2025.11195026
Primary Topic
Robotic Path Planning Algorithms
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Adaptive Reinforcement Learning Path Planning Method for Indoor Complex Dynamic Environments

Yang Yang, Wanting Liu, Siyu Lin, Songqi Xingl
Robotic Path Planning Algorithms
article

An Adaptive Reinforcement Learning Path Planning Method for Indoor Complex Dynamic Environments

Yang Yang, Wanting Liu, Siyu Lin, Songqi Xingl
article en

Abstract

Path planning in indoor complex dynamic environments faces challenges such as frequent obstacle movements, high environmental uncertainty, and difficulty for agents to achieve stable convergence. Existing algorithms have limitations in adaptability, convergence speed, and path quality. To address these issues, this paper proposes an Adaptive Prioritized Experience Double Deep Q-Network Path Optimization method (APE-DPO), which integrates dynamic perturbation optimization, adaptive exploration rate adjustment, and a prioritized experience replay mechanism to enhance the agent's respon-siveness to dynamic environments and improve policy stability. Experiments conducted in three representative dynamic sce-narios-home, restaurant, and library-demonstrate that APE- DPO outperforms representative reinforcement learning models in the path planning domain, including DQN, DDQN, and their variants, in terms of path length, success rate, and convergence speed. In some scenarios, path length is reduced by 6.9% to 12.5%, showing strong robustness and practical application potential.

Changchun University of Science and Technology (CN)
Openalex Percentile: Top 71%
Robotic Path Planning Algorithms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.