Reinforcement Learning in Cognitive Robots for Autonomous Path Planning

Cognitive robots are intelligent systems that learn from their environment, adapt to dynamic changes, and make decisions without a human's direct intervention. This research studies the integration of Reinforcement Learning in cognitive robots with Q-Learning for autonomous path planning. The study addresses the most critical issues in traditional A* and Dynamic Programming algorithms by devising path-planning techniques, mainly the lack of adaptability and computational efficiency in real-time and unpredictable environments. Our approach is based on Q-Learning, which is a model-free RL algorithm allowing the robots to find paths autonomously by optimizing their paths and avoiding obstacles. The Q-Learning algorithm provides the possibility of learning optimal policies for the robot through iterative interaction with its environment balanced between exploration and exploitation of the decision process. A reward system is utilized by the proposed model, encouraging the robot to explore shorter, collision-free paths and adjust based on feedback in real time from its surroundings. The model was found to be significantly better than its counterparts. In this context, as indicated, the Q-Learning model runs at 11.5 seconds, faster than A* at 18.3 seconds and Dynamic Programming at 16.7 seconds, yet with an accuracy of 94% and was found to have the highest collision avoidance rate at 98%. Additionally, the adaptability of the model about the environment presents a marked difference in terms of path length optimization, having done so with a mean path length of 12.3, compared to approaches or models. The robustness and scalability of the Q-Learning model make it highly applicable in real-world applications.

Authors

Institutions

Publication Details

Published
2024-11-18
DOI
https://doi.org/10.1109/icdici62993.2024.10810955
Primary Topic
Reinforcement Learning in Robotics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Reinforcement Learning in Cognitive Robots for Autonomous Path Planning

G. Deepa, K. Selva Sheela, R. Indu Poornima, Akshya Jothi et al.
Reinforcement Learning in Robotics
article

Reinforcement Learning in Cognitive Robots for Autonomous Path Planning

G. Deepa, K. Selva Sheela, R. Indu Poornima, Akshya Jothi, Archana Das, Mani Deepak Choudhry
article en

Abstract

Cognitive robots are intelligent systems that learn from their environment, adapt to dynamic changes, and make decisions without a human's direct intervention. This research studies the integration of Reinforcement Learning in cognitive robots with Q-Learning for autonomous path planning. The study addresses the most critical issues in traditional A* and Dynamic Programming algorithms by devising path-planning techniques, mainly the lack of adaptability and computational efficiency in real-time and unpredictable environments. Our approach is based on Q-Learning, which is a model-free RL algorithm allowing the robots to find paths autonomously by optimizing their paths and avoiding obstacles. The Q-Learning algorithm provides the possibility of learning optimal policies for the robot through iterative interaction with its environment balanced between exploration and exploitation of the decision process. A reward system is utilized by the proposed model, encouraging the robot to explore shorter, collision-free paths and adjust based on feedback in real time from its surroundings. The model was found to be significantly better than its counterparts. In this context, as indicated, the Q-Learning model runs at 11.5 seconds, faster than A* at 18.3 seconds and Dynamic Programming at 16.7 seconds, yet with an accuracy of 94% and was found to have the highest collision avoidance rate at 98%. Additionally, the adaptability of the model about the environment presents a marked difference in terms of path length optimization, having done so with a mean path length of 12.3, compared to approaches or models. The robustness and scalability of the Q-Learning model make it highly applicable in real-world applications.

SRM Institute of Science and Technology (IN), Horizon College and Seminary (CA), PSG INSTITUTE OF TECHNOLOGY AND APPLIED RESEARCH (IN), KPR Institute of Engineering and Technology (IN)
Openalex Percentile: Top 78%
Reinforcement Learning in Robotics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.