Pareto-Optimal Coverage Control for Multi-Objective Multi-Agent Systems: A General Sum Game Reinforcement Learning Perspective
Individual performance variations, target conflicts, and dynamic scenarios pose challenges in creating effective solutions to balance individual and collective benefits in collaborative multi-agent area coverage control. To address these challenges, this paper proposes a semi-distributed Pareto-optimal policy iteration algorithm (SDPOPI). This algorithm introduces a multi-objective group game (MOGG) model that accounts for conflicting objectives such as coverage efficiency, group density, energy consumption, and communication topology equilibrium. By guiding the distributed reinforcement learning policy iteration process through a game interaction mechanism, the algorithm establishes a dual-layer semi-distributed policy iteration frame-work that achieves the Pareto-Nash equilibrium for the MOGG, thereby balancing individual and group benefits. Simulation results validate the accuracy and practical applicability of the proposed method.
Authors
- Wei Xie (ORCID: https://orcid.org/0000-0003-4984-6659)
- Xiwen Ma (ORCID: https://orcid.org/0000-0001-9212-3523)
- Zhihuan Hu (ORCID: https://orcid.org/0000-0003-4600-9281)
- Hongtian Chen (ORCID: https://orcid.org/0000-0002-8600-9668)
- Jingsong Yang
- Weidong Zhang (ORCID: https://orcid.org/0000-0002-8165-625X)
Institutions
- Shanghai Jiao Tong University (CN)
Publication Details
- Published
- 2024-10-18
- DOI
- https://doi.org/10.1109/iccsse63803.2024.10824032
- Primary Topic
- Mathematical and Theoretical Epidemiology and Ecology Models
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Natural Science Foundation of Zhejiang Province