An IoT-enabled reinforcement learning-driven ground robot for precision navigation and smart interaction in dynamic environments

Autonomous ground robots are increasingly relied upon in dynamic environments where reliable navigation and context-aware interaction are essential. However, existing robotic control systems often rely on cloud-based reinforcement learning (RL) frameworks or static algorithms that fail to adapt in real-time to noisy, unpredictable scenarios. These models typically overlook the constraints of edge deployment and lack robust integration with human interaction modalities such as voice and semantic object awareness. To address these limitations, this work proposes a fully embedded, IoT-enabled ground robot powered by a reinforcement learning-based adaptive control framework. The system leverages Raspberry Pi 4B+ as its core computational unit, integrating MQTT-driven communication, multimodal interaction through speech and vision, and lightweight policy convergence for obstacle-aware navigation. A novel RL-based state-action pipeline is trained and deployed entirely on-device, ensuring real-time responsiveness without external computation. Experimental evaluations show that the proposed framework reduces navigation errors by 22% and improves interaction latency by 37% over traditional PID and A*-based systems. The RL model converges in under 2200 episodes, with stable reward curves and high reliability across variable acoustic and physical terrains. This study showcases how low-cost, edge-based robots can achieve high autonomy and situational awareness contributing to future advancements in resilient, self-adaptive robotic systems within smart and resource-constrained environments.

Authors

Publication Details

Journal
International Journal of Data and Network Science
Published
2025-01-01
DOI
https://doi.org/10.5267/j.ijdns.2025.8.007
Citations
1
Primary Topic
Robotics and Automated Systems
Type
article
Field-Weighted Citation Impact
1.21

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An IoT-enabled reinforcement learning-driven ground robot for precision navigation and smart interaction in dynamic environments

Udit Mamodiya, Indra Kishor, Rami Shehab, Theyazn H. H. Aldhyani et al.
1 citations
International Journal of Data and Network Science
Robotics and Automated Systems
1.21
article

An IoT-enabled reinforcement learning-driven ground robot for precision navigation and smart interaction in dynamic environments

Udit Mamodiya, Indra Kishor, Rami Shehab, Theyazn H. H. Aldhyani, Mohammed Amin Almaiah, Mansour Obeidat
article en
1 citations

Abstract

Autonomous ground robots are increasingly relied upon in dynamic environments where reliable navigation and context-aware interaction are essential. However, existing robotic control systems often rely on cloud-based reinforcement learning (RL) frameworks or static algorithms that fail to adapt in real-time to noisy, unpredictable scenarios. These models typically overlook the constraints of edge deployment and lack robust integration with human interaction modalities such as voice and semantic object awareness. To address these limitations, this work proposes a fully embedded, IoT-enabled ground robot powered by a reinforcement learning-based adaptive control framework. The system leverages Raspberry Pi 4B+ as its core computational unit, integrating MQTT-driven communication, multimodal interaction through speech and vision, and lightweight policy convergence for obstacle-aware navigation. A novel RL-based state-action pipeline is trained and deployed entirely on-device, ensuring real-time responsiveness without external computation. Experimental evaluations show that the proposed framework reduces navigation errors by 22% and improves interaction latency by 37% over traditional PID and A*-based systems. The RL model converges in under 2200 episodes, with stable reward curves and high reliability across variable acoustic and physical terrains. This study showcases how low-cost, edge-based robots can achieve high autonomy and situational awareness contributing to future advancements in resilient, self-adaptive robotic systems within smart and resource-constrained environments.

International Journal of Data and Network ScienceVol. 9(4)
King Faisal University
Openalex Percentile: Top 17%
Robotics and Automated Systems
1.21
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

An IoT-enabled reinforcement learning-driven ground robot for precision navigation and smart interaction in dynamic environments — Udit Mamodiya, Indra Kishor, et al. · International Journal of Data and Network Science (2025) | TGRS Research Map | TGRS