Adaptive Autonomy in Microrobot Motion Control via Deep Reinforcement Learning and Path Planning Synergy

Microrobots show great promise in biomedicine and environmental remediation, yet precise control in complex environments remains a significant challenge. Despite advancements in intelligent control systems, they often suffer from sample inefficiency and prolonged training times. This study presents a data‐driven framework to train deep reinforcement learning (DRL) algorithms for autonomous microrobot motion control. A supervised artificial neural network (SuANN) is trained to emulate microrobot–environment interactions based on data from a soft actor‐critic (SAC) model trained in a physical system. The truncated quantile critics (TQC) algorithm is then trained within this simulated environment. Integrated with A* path planning, the TQC‐SuANN model demonstrated superior real‐time obstacle avoidance and control accuracy in environments containing static and dynamic obstacles, as well as moving targets. Compared to the baseline SAC model, TQC‐SuANN achieved a 30.69% reduction in path deviation and a 23.43% increase in task completion speed. This approach significantly reduced training time, improved sample efficiency, and enhanced DRL performance for microrobot control. This framework enables scalable, efficient control of microrobots in complex environments.

Authors

Institutions

Publication Details

Journal
Advanced Intelligent Systems
Published
2026-01-06
DOI
https://doi.org/10.1002/aisy.202501053
Primary Topic
Reinforcement Learning in Robotics
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Adaptive Autonomy in Microrobot Motion Control via Deep Reinforcement Learning and Path Planning Synergy

Amar Salehi, Haoyu Liu, Tingting Yu, Bairong Zhu
Advanced Intelligent Systems
Reinforcement Learning in Robotics
article

Adaptive Autonomy in Microrobot Motion Control via Deep Reinforcement Learning and Path Planning Synergy

Amar Salehi, Haoyu Liu, Tingting Yu, Bairong Zhu
article en

Abstract

Microrobots show great promise in biomedicine and environmental remediation, yet precise control in complex environments remains a significant challenge. Despite advancements in intelligent control systems, they often suffer from sample inefficiency and prolonged training times. This study presents a data‐driven framework to train deep reinforcement learning (DRL) algorithms for autonomous microrobot motion control. A supervised artificial neural network (SuANN) is trained to emulate microrobot–environment interactions based on data from a soft actor‐critic (SAC) model trained in a physical system. The truncated quantile critics (TQC) algorithm is then trained within this simulated environment. Integrated with A* path planning, the TQC‐SuANN model demonstrated superior real‐time obstacle avoidance and control accuracy in environments containing static and dynamic obstacles, as well as moving targets. Compared to the baseline SAC model, TQC‐SuANN achieved a 30.69% reduction in path deviation and a 23.43% increase in task completion speed. This approach significantly reduced training time, improved sample efficiency, and enhanced DRL performance for microrobot control. This framework enables scalable, efficient control of microrobots in complex environments.

Advanced Intelligent Systems
South China University of Technology (CN)
National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities
Openalex Percentile: Top 95%
Reinforcement Learning in Robotics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Adaptive Autonomy in Microrobot Motion Control via Deep Reinforcement Learning and Path Planning Synergy — Amar Salehi, Haoyu Liu, et al. · Advanced Intelligent Systems (2026) | TGRS Research Map | TGRS