Path Planning under High-dimensional Input States Based on Deep Q-Network

The field of autonomous navigation continues to face challenges in path planning, particularly when addressing the complex, high-dimensional input states that conventional algorithms struggle to process efficiently. This study presents a novel path-planning approach that utilizes Deep Q-Networks (DQN) to manage intricate and multidimensional environmental data. By integrating a DQN with path planning, this study aims to develop an adaptive system capable of making real-time decisions in dynamic environments. The methodology involves training a neural network to approximate the Q-function, enabling the agent to learn optimal strategies directly from unprocessed sensor data such as visual or LiDAR inputs. Experiments conducted in both simulated and real-world scenarios demonstrated the efficacy of this method, revealing significant improvements in route optimization, computational efficiency, and robustness against unforeseen obstacles compared to traditional techniques. The proposed system was evaluated in diverse settings, including urban environments and challenging terrain, illustrating its versatility. These findings suggest that DQN-based path planning has considerable potential for applications in robotics, autonomous vehicles, and other domains requiring intelligent decision-making under uncertainty.

Authors

Institutions

Publication Details

Journal
Highlights in Science Engineering and Technology
Published
2024-12-25
DOI
https://doi.org/10.54097/r6fs0580
Citations
4
Primary Topic
Robotic Path Planning Algorithms
Type
article
Field-Weighted Citation Impact
1.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Path Planning under High-dimensional Input States Based on Deep Q-Network

Yixian Yang
4 citations
Highlights in Science Engineering and Technology
Robotic Path Planning Algorithms
1.00
article

Path Planning under High-dimensional Input States Based on Deep Q-Network

Yixian Yang
article en
4 citations

Abstract

The field of autonomous navigation continues to face challenges in path planning, particularly when addressing the complex, high-dimensional input states that conventional algorithms struggle to process efficiently. This study presents a novel path-planning approach that utilizes Deep Q-Networks (DQN) to manage intricate and multidimensional environmental data. By integrating a DQN with path planning, this study aims to develop an adaptive system capable of making real-time decisions in dynamic environments. The methodology involves training a neural network to approximate the Q-function, enabling the agent to learn optimal strategies directly from unprocessed sensor data such as visual or LiDAR inputs. Experiments conducted in both simulated and real-world scenarios demonstrated the efficacy of this method, revealing significant improvements in route optimization, computational efficiency, and robustness against unforeseen obstacles compared to traditional techniques. The proposed system was evaluated in diverse settings, including urban environments and challenging terrain, illustrating its versatility. These findings suggest that DQN-based path planning has considerable potential for applications in robotics, autonomous vehicles, and other domains requiring intelligent decision-making under uncertainty.

Highlights in Science Engineering and TechnologyVol. 120
China University of Geosciences (CN)
Sustainable cities and communities
Openalex Percentile: Top 21%
Robotic Path Planning Algorithms
1.00
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.