Event-Triggered Optimal Bipartite Consensus Control for Constrained Multiagent Systems via Internal Reinforce <i>Q</i>-Learning

In this article, the event-triggered optimal bipartite consensus control problem is investigated for second-order discrete-time multiagent systems (MASs) with control input saturation and unknown system models. First, an instant reward signal with nonquadratic functions dealing with the control input saturation is defined, based on which a novel internal reinforce reward function is defined to facilitates agents to learn more intrinsic information from the local environment. Then, a novel event-triggered internal reinforce Q-learning (IrQL) algorithm is introduced. In contrast to conventional time-triggering Q-learning methods, the proposed event-triggered IrQL algorithm can not only fully exploit environment but also save the data computation and transmission resources. Based on elegant functional analysis techniques and Lyapunov stability theory, the internal reinforce reward function can be proved to be bounded and the tracking error dynamics of MASs are ensured asymptotic stability under the proposed event-triggered control policies. Then, data-driven reinforce-critic-actor neural networks are constructed to implement the event-triggered IrQL algorithm online with the proof of convergence. Finally, simulation examples show the validity and better performance over existing researches.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Cybernetics
Published
2025-06-24
DOI
https://doi.org/10.1109/tcyb.2025.3577500
Primary Topic
Distributed Control Multi-Agent Systems
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Event-Triggered Optimal Bipartite Consensus Control for Constrained Multiagent Systems via Internal Reinforce Q-Learning

Cong Bi, Meng Wang, Xin Gui, Huaicheng Yan
IEEE Transactions on Cybernetics
Distributed Control Multi-Agent Systems
article

Event-Triggered Optimal Bipartite Consensus Control for Constrained Multiagent Systems via Internal Reinforce Q-Learning

Cong Bi, Meng Wang, Xin Gui, Huaicheng Yan
article en

Abstract

In this article, the event-triggered optimal bipartite consensus control problem is investigated for second-order discrete-time multiagent systems (MASs) with control input saturation and unknown system models. First, an instant reward signal with nonquadratic functions dealing with the control input saturation is defined, based on which a novel internal reinforce reward function is defined to facilitates agents to learn more intrinsic information from the local environment. Then, a novel event-triggered internal reinforce Q-learning (IrQL) algorithm is introduced. In contrast to conventional time-triggering Q-learning methods, the proposed event-triggered IrQL algorithm can not only fully exploit environment but also save the data computation and transmission resources. Based on elegant functional analysis techniques and Lyapunov stability theory, the internal reinforce reward function can be proved to be bounded and the tracking error dynamics of MASs are ensured asymptotic stability under the proposed event-triggered control policies. Then, data-driven reinforce-critic-actor neural networks are constructed to implement the event-triggered IrQL algorithm online with the proof of convergence. Finally, simulation examples show the validity and better performance over existing researches.

IEEE Transactions on CyberneticsVol. 55(8)
East China University of Science and Technology (CN), Nankai University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 84%
Distributed Control Multi-Agent Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.