High-dimensional continuous action space control via trust region optimized deep reinforcement learning

The present research introduces the Adaptive Trust Region Policy Optimization for Action Space Compression (ATRPO-ACS) framework, a novel deep reinforcement learning approach optimized through trust region strategies, designed to address adaptive control challenges in high-dimensional continuous action spaces. By integrating distributed KL constraint optimization and manifold projection with residual compensation, the framework achieves significant improvements in sampling efficiency and real-time performance while reducing trajectory tracking errors and voltage limit violations. Experimental validations demonstrate its superior performance, with robotic arm tracking errors maintained within ± 0.08 mm and microgrid scheduling costs reduced by 28.5%. The framework also notably shortens production cycles in automotive welding lines. These advancements provide robust theoretical and technical support for real-time optimization control in industrial intelligent systems.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2025-11-28
DOI
https://doi.org/10.1038/s41598-025-29756-y
Primary Topic
Robot Manipulation and Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

High-dimensional continuous action space control via trust region optimized deep reinforcement learning

Xia Wang
Scientific Reports
Robot Manipulation and Learning
article

High-dimensional continuous action space control via trust region optimized deep reinforcement learning

Xia Wang
article en

Abstract

The present research introduces the Adaptive Trust Region Policy Optimization for Action Space Compression (ATRPO-ACS) framework, a novel deep reinforcement learning approach optimized through trust region strategies, designed to address adaptive control challenges in high-dimensional continuous action spaces. By integrating distributed KL constraint optimization and manifold projection with residual compensation, the framework achieves significant improvements in sampling efficiency and real-time performance while reducing trajectory tracking errors and voltage limit violations. Experimental validations demonstrate its superior performance, with robotic arm tracking errors maintained within ± 0.08 mm and microgrid scheduling costs reduced by 28.5%. The framework also notably shortens production cycles in automotive welding lines. These advancements provide robust theoretical and technical support for real-time optimization control in industrial intelligent systems.

Scientific ReportsVol. 15(1)
Lanzhou University of Technology (CN), Lanzhou Petrochemical Polytechnic (CN)
Openalex Percentile: Top 54%
Robot Manipulation and Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

High-dimensional continuous action space control via trust region optimized deep reinforcement learning — Xia Wang · Scientific Reports (2025) | TGRS Research Map | TGRS