Decentralized Triggering and Event-Based Integral Reinforcement Learning for Multiplayer Differential Game Systems

Multiplayer differential games are typically characterized by multiple control loops, where communication resources are periodically transmitted and control policies are updated in a time-triggered manner. In this paper, two different event-triggered mechanisms are proposed for a class of multiplayer nonzero-sum differential game systems. Specifically, by defining a global sampled state, a centralized triggering rule is devised to manage state sampling and control updating in a synchronized manner. By considering each player's preferences, the decentralized triggering rule is devised in which a local event generator produces the triggering sequence independently. On the other hand, with experience replay and integral reinforcement learning, an event-based adaptive learning scheme is developed, which is implemented by critic neural networks and only requires partial knowledge of system dynamics. The theoretical results indicate that both two triggering mechanisms can guarantee the asymptotic stability and weight convergence. Finally, simulation results on a three-player numerical system and a two-player supersonic transport system substantiate the effectiveness of two learning-based triggering mechanisms.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Emerging Topics in Computational Intelligence
Published
2024-10-07
DOI
https://doi.org/10.1109/tetci.2024.3372389
Citations
2
Primary Topic
Reinforcement Learning in Robotics
Type
article
Field-Weighted Citation Impact
0.69

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Decentralized Triggering and Event-Based Integral Reinforcement Learning for Multiplayer Differential Game Systems

Song Zhu, Ke Wang, Chaoxu Mu, Guangbin Cai
2 citations
IEEE Transactions on Emerging Topics in Computational Intelligence
Reinforcement Learning in Robotics
0.69
article

Decentralized Triggering and Event-Based Integral Reinforcement Learning for Multiplayer Differential Game Systems

Song Zhu, Ke Wang, Chaoxu Mu, Guangbin Cai
article en
2 citations

Abstract

Multiplayer differential games are typically characterized by multiple control loops, where communication resources are periodically transmitted and control policies are updated in a time-triggered manner. In this paper, two different event-triggered mechanisms are proposed for a class of multiplayer nonzero-sum differential game systems. Specifically, by defining a global sampled state, a centralized triggering rule is devised to manage state sampling and control updating in a synchronized manner. By considering each player's preferences, the decentralized triggering rule is devised in which a local event generator produces the triggering sequence independently. On the other hand, with experience replay and integral reinforcement learning, an event-based adaptive learning scheme is developed, which is implemented by critic neural networks and only requires partial knowledge of system dynamics. The theoretical results indicate that both two triggering mechanisms can guarantee the asymptotic stability and weight convergence. Finally, simulation results on a three-player numerical system and a two-player supersonic transport system substantiate the effectiveness of two learning-based triggering mechanisms.

IEEE Transactions on Emerging Topics in Computational IntelligenceVol. 8(6)
Tianjin University (CN), China University of Mining and Technology (CN), PLA Rocket Force University of Engineering (CN)
National Natural Science Foundation of China, China Postdoctoral Science Foundation
Reduced inequalities
Openalex Percentile: Top 24%
Reinforcement Learning in Robotics
0.69
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.