Action-Curiosity-Based Deep Reinforcement Learning Algorithm for Path Planning in a Nondeterministic Environment

In the field of path planning, the efficiency and effectiveness of deep reinforcement learning (DRL) methods are often constrained by the algorithms’ exploration capabilities, particularly in dynamic and nondeterministic environments. This paper introduces a novel DRL optimization approach predicated on an action curiosity mechanism, designed to enhance both performance and efficiency in uncertain settings. By incentivizing agents to explore their surroundings more effectively, the action curiosity module amplifies learning efficiency and curtails training duration. The method’s adaptability and stability in intricate or dynamic scenarios are augmented through a dynamically adjusted reward mechanism. To mitigate the issue of strategy degradation stemming from excessive exploration, we incorporate a cosine annealing strategy that finesses parameter adjustments in real time. Extensive experimentation reveals that our enhanced algorithm outperforms conventional methods markedly in terms of success rate and average reward, among other metrics. These experimental outcomes corroborate the proposed method’s robustness and efficacy, laying a solid groundwork for efficient adaptive autonomous path planning within complex and nondeterministic environments.

Authors

Institutions

Publication Details

Journal
Intelligent Computing
Published
2025-01-01
DOI
https://doi.org/10.34133/icomputing.0140
Citations
9
Primary Topic
Robotic Path Planning Algorithms
Type
article
Field-Weighted Citation Impact
11.48
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Action-Curiosity-Based Deep Reinforcement Learning Algorithm for Path Planning in a Nondeterministic Environment

Jinpu Chen, Junxiao Xue, Shiwen Zhang
9 citations
Intelligent Computing
Robotic Path Planning Algorithms
11.48
article

Action-Curiosity-Based Deep Reinforcement Learning Algorithm for Path Planning in a Nondeterministic Environment

Jinpu Chen, Junxiao Xue, Shiwen Zhang
article en
9 citations

Abstract

In the field of path planning, the efficiency and effectiveness of deep reinforcement learning (DRL) methods are often constrained by the algorithms’ exploration capabilities, particularly in dynamic and nondeterministic environments. This paper introduces a novel DRL optimization approach predicated on an action curiosity mechanism, designed to enhance both performance and efficiency in uncertain settings. By incentivizing agents to explore their surroundings more effectively, the action curiosity module amplifies learning efficiency and curtails training duration. The method’s adaptability and stability in intricate or dynamic scenarios are augmented through a dynamically adjusted reward mechanism. To mitigate the issue of strategy degradation stemming from excessive exploration, we incorporate a cosine annealing strategy that finesses parameter adjustments in real time. Extensive experimentation reveals that our enhanced algorithm outperforms conventional methods markedly in terms of success rate and average reward, among other metrics. These experimental outcomes corroborate the proposed method’s robustness and efficacy, laying a solid groundwork for efficient adaptive autonomous path planning within complex and nondeterministic environments.

Intelligent ComputingVol. 4
Zhengzhou University (CN), Zhejiang Lab (CN)
Openalex Percentile: Top 1%
Robotic Path Planning Algorithms
11.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.