Design of a Multi-Agent Collaborative Decision-Making System Based on Reinforcement Learning

This paper proposes a modular multi-agent reinforcement learning framework that integrates Centralized Training with Decentralized Execution (CTDE), attention-based communication, and adaptive reward shaping. Built upon an extended Soft Actor–Critic algorithm, the system enables decentralized agents to learn robust policies under partial observability. A shared critic computes value estimates using the full global state, while decentralized actors use selectively aggregated peer messages via a task-driven attention mechanism. Adaptive reward shaping dynamically aligns agent incentives with global objectives, accelerating convergence. The system is evaluated on three benchmarks: Multi-Agent Particle Environment (MPE), StarCraft II Micromanagement Challenge (SMAC), and a custom Resource Allocation Simulator (RAS). Compared to MAPPO, MADDPG, and ISAC baselines, our method improves average episodic reward by 15–25%, reduces convergence steps by up to 40%, and enhances coordination scores significantly. Results also show superior stability across random seeds and reduced wall-clock training time, highlighting the method’s effectiveness for real-world deployment in dynamic multi-agent settings.

Authors

Institutions

Publication Details

Journal
International Journal of Pattern Recognition and Artificial Intelligence
Published
2025-11-08
DOI
https://doi.org/10.1142/s021800142551022x
Primary Topic
Reinforcement Learning in Robotics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Design of a Multi-Agent Collaborative Decision-Making System Based on Reinforcement Learning

Zhe Wei, Meiyan Zhou
International Journal of Pattern Recognition and Artificial Intelligence
Reinforcement Learning in Robotics
article

Design of a Multi-Agent Collaborative Decision-Making System Based on Reinforcement Learning

Zhe Wei, Meiyan Zhou
article en

Abstract

This paper proposes a modular multi-agent reinforcement learning framework that integrates Centralized Training with Decentralized Execution (CTDE), attention-based communication, and adaptive reward shaping. Built upon an extended Soft Actor–Critic algorithm, the system enables decentralized agents to learn robust policies under partial observability. A shared critic computes value estimates using the full global state, while decentralized actors use selectively aggregated peer messages via a task-driven attention mechanism. Adaptive reward shaping dynamically aligns agent incentives with global objectives, accelerating convergence. The system is evaluated on three benchmarks: Multi-Agent Particle Environment (MPE), StarCraft II Micromanagement Challenge (SMAC), and a custom Resource Allocation Simulator (RAS). Compared to MAPPO, MADDPG, and ISAC baselines, our method improves average episodic reward by 15–25%, reduces convergence steps by up to 40%, and enhances coordination scores significantly. Results also show superior stability across random seeds and reduced wall-clock training time, highlighting the method’s effectiveness for real-world deployment in dynamic multi-agent settings.

International Journal of Pattern Recognition and Artificial IntelligenceVol. 40(01)
Hunan University of Arts and Science (CN), The First People's Hospital of Changde (CN)
Openalex Percentile: Top 82%
Reinforcement Learning in Robotics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.