High-dimensional continuous action space control via trust region optimized deep reinforcement learning
The present research introduces the Adaptive Trust Region Policy Optimization for Action Space Compression (ATRPO-ACS) framework, a novel deep reinforcement learning approach optimized through trust region strategies, designed to address adaptive control challenges in high-dimensional continuous action spaces. By integrating distributed KL constraint optimization and manifold projection with residual compensation, the framework achieves significant improvements in sampling efficiency and real-time performance while reducing trajectory tracking errors and voltage limit violations. Experimental validations demonstrate its superior performance, with robotic arm tracking errors maintained within ± 0.08 mm and microgrid scheduling costs reduced by 28.5%. The framework also notably shortens production cycles in automotive welding lines. These advancements provide robust theoretical and technical support for real-time optimization control in industrial intelligent systems.
Authors
- Xia Wang (ORCID: https://orcid.org/0000-0003-0674-3692)
Institutions
- Lanzhou University of Technology (CN)
- Lanzhou Petrochemical Polytechnic (CN)
Publication Details
- Journal
- Scientific Reports
- Published
- 2025-11-28
- DOI
- https://doi.org/10.1038/s41598-025-29756-y
- Primary Topic
- Robot Manipulation and Learning
- Type
- article
- Field-Weighted Citation Impact
- 0.00