Multi-Robot Collaboration for Dynamic Environments: A Study Based on the Improved PPO Algorithm
With the expanding applications of multi-robot systems in complex dynamic environments, efficiently coordinating multiple robots to complete intricate tasks has become a hot research topic. This study proposes an improved Proximal Policy Optimization (PPO) algorithm, which optimizes inter-robot collaboration through reinforcement learning to enhance the adaptability and stability of multi-robot systems in dynamic environments. We employ a Markov Decision Process (MDP) framework and coordinate each robot using a joint reward function to achieve global task optimization in complex tasks. Experimental results demonstrate that the improved PPO significantly outperforms traditional PPO and MPC methods in terms of task completion efficiency, collaboration efficiency, and stability, especially when facing environmental disturbances and increased task complexity. The improved PPO algorithm shows stronger adaptability and robustness, proving its superiority in multi-robot collaborative tasks.
Authors
- Guodong Wang (ORCID: https://orcid.org/0000-0001-9917-0656)
- Chao Yang (ORCID: https://orcid.org/0009-0009-7637-7254)
- Z. X. Li (ORCID: https://orcid.org/0009-0000-4559-0591)
- Zhuoxiao Li
- Yijie Jiang (ORCID: https://orcid.org/0000-0001-5713-1229)
Institutions
- Beihang University (CN)
Publication Details
- Published
- 2025-03-21
- DOI
- https://doi.org/10.1109/icaace65325.2025.11019702
- Citations
- 1
- Primary Topic
- Advanced Manufacturing and Logistics Optimization
- Type
- article
- Field-Weighted Citation Impact
- 1.24