Learning-based AI pursuit in dynamic environments with environmental constraints

This research explores the efficiency of reinforcement learning (RL) for developing intelligent pursuit AI in dynamic 3D game environments with challenges like slippery surfaces and obstacles. We developed an RL agent trained via curriculum learning to help it gradually learn how to avoid obstacles and take advantage of the environment’s physics. The RL agent shows promising adaptability and unique capabilities, particularly in handling slippery surfaces. Its performance was benchmarked against a tradi- tional NavMesh agent. While the NavMesh agent generally achieved better results in speed and safety, almost always reaching the target in 4.63s, the RL agent, on the other hand, though generally slower (4.71s-5.02s), it showed promising adaptability in different environments. The RL agent’s performance depended a lot on how the environment was set up; removal of a single initial obstacle significantly improved its performance and reduced collisions. This shows RL’s ability to handle complex interactions, but also shows that it might struggle to consistently beat traditional methods.

Authors

Institutions

Publication Details

Journal
Procedia Computer Science
Published
2025-01-01
DOI
https://doi.org/10.1016/j.procs.2025.09.115
Primary Topic
Reinforcement Learning in Robotics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Learning-based AI pursuit in dynamic environments with environmental constraints

Allan James, Sonya Rapinta Manalu, Kenneth Christopher Haryanto, William Luhur
Procedia Computer Science
Reinforcement Learning in Robotics
article

Learning-based AI pursuit in dynamic environments with environmental constraints

Allan James, Sonya Rapinta Manalu, Kenneth Christopher Haryanto, William Luhur
article en

Abstract

This research explores the efficiency of reinforcement learning (RL) for developing intelligent pursuit AI in dynamic 3D game environments with challenges like slippery surfaces and obstacles. We developed an RL agent trained via curriculum learning to help it gradually learn how to avoid obstacles and take advantage of the environment’s physics. The RL agent shows promising adaptability and unique capabilities, particularly in handling slippery surfaces. Its performance was benchmarked against a tradi- tional NavMesh agent. While the NavMesh agent generally achieved better results in speed and safety, almost always reaching the target in 4.63s, the RL agent, on the other hand, though generally slower (4.71s-5.02s), it showed promising adaptability in different environments. The RL agent’s performance depended a lot on how the environment was set up; removal of a single initial obstacle significantly improved its performance and reduced collisions. This shows RL’s ability to handle complex interactions, but also shows that it might struggle to consistently beat traditional methods.

Procedia Computer ScienceVol. 269
Binus University (ID)
Openalex Percentile: Top 83%
Reinforcement Learning in Robotics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.