Human-Risk-Aware Safe Path Planning Based on Reinforcement Learning for Autonomous Mobile Robots
This paper addresses the challenge of safe path planning for mobile robots operating in human-shared environments, where human movements are inherently stochastic. To this end, we propose a reinforcement-learning-based path planning algorithm that accounts for human-related uncertainties at the planning level. The algorithm first employs a Markov decision process learner to explore the environment and generate multiple candidate paths. Second, to reduce computational redundancy, a path eliminator module filters out similar paths based on a proposed diversity metric, ensuring path diversity with minimal overhead. Simultaneously, a Monte Carlo-simulated human risk predictor is integrated into the decision-making unit to select the safest path among the candidates. This integrated algorithm enables robots to generate safe and efficient trajectories without the need for frequent re-planning, even in environments with stochastic human behavior. Simulation results demonstrate the effectiveness of the proposed method. In high-density settings, a 40×40 grid map with 10 humans, the proposed method reduces the average number of conflicts by -69.8%, -54.8%, and -73.4% compared with A*, MDP, and RRT methods, respectively. Meanwhile, it improves task success rates by 94.4%, 70.7%, and 118.75% relative to the same baseline methods.
Authors
- Zhongjie Long (ORCID: https://orcid.org/0000-0001-9009-5872)
- Xianbo Zhang (ORCID: https://orcid.org/0009-0007-3701-8721)
- Jian Mi (ORCID: https://orcid.org/0000-0002-8996-6631)
- Jun Wang (ORCID: https://orcid.org/0000-0002-3686-9272)
Institutions
- Beijing University of Chemical Technology (CN)
- Beijing Information Science & Technology University (CN)
- Yangzhou University (CN)
Publication Details
- Journal
- Sensors
- Published
- 2025-11-26
- DOI
- https://doi.org/10.3390/s25237211
- Primary Topic
- Robotic Path Planning Algorithms
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Government of Jiangsu Province
- Natural Science Foundation of Jiangsu Province