Lyapunov-guided cooperative games enable stable constraint fusion in LLM-based multi-agent autonomous systems

In large language model-based multi-agent systems, the constraints of individual agents are mutually coupled and evolve dynamically throughout the generation process during collaborative decision-making. Without a convergence mechanism, the system state tends to oscillate among multiple local solutions, failing to converge stably toward a feasible solution that satisfies all constraints. This paper formulates the constraint fusion problem as a stability convergence problem of dynamical systems and proposes a Lyapunov-guided cooperative differential game framework. The framework integrates multi-dimensional constraint deviations into a unified system state metric via a Lyapunov function and, drawing on cooperative differential game theory, searches for approximate Pareto-improving directions within a model predictive control formulation. Real-time constraint intervention on the generation process is achieved through exponential penalty modifications to the token probability distributions of the large language model, mapping the theoretically continuous control variables to actionable discrete generation strategies. Experiments conducted on the nuScenes dataset using Llama3:8B demonstrate that the proposed framework outperforms existing baseline methods in collision rate, trajectory accuracy, and constraint satisfaction rate, with the overall constraint satisfaction rate improving by 7.0% over the best-performing baseline.

Authors

Institutions

Publication Details

Journal
npj Artificial Intelligence
Published
2026-05-08
DOI
https://doi.org/10.1038/s44387-026-00110-5
Primary Topic
Reinforcement Learning in Robotics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Lyapunov-guided cooperative games enable stable constraint fusion in LLM-based multi-agent autonomous systems

Dagang Li, Qianqi Zhang, Yuntao Zou, Zeling Xu
npj Artificial Intelligence
Reinforcement Learning in Robotics
article

Lyapunov-guided cooperative games enable stable constraint fusion in LLM-based multi-agent autonomous systems

Dagang Li, Qianqi Zhang, Yuntao Zou, Zeling Xu
article en

Abstract

In large language model-based multi-agent systems, the constraints of individual agents are mutually coupled and evolve dynamically throughout the generation process during collaborative decision-making. Without a convergence mechanism, the system state tends to oscillate among multiple local solutions, failing to converge stably toward a feasible solution that satisfies all constraints. This paper formulates the constraint fusion problem as a stability convergence problem of dynamical systems and proposes a Lyapunov-guided cooperative differential game framework. The framework integrates multi-dimensional constraint deviations into a unified system state metric via a Lyapunov function and, drawing on cooperative differential game theory, searches for approximate Pareto-improving directions within a model predictive control formulation. Real-time constraint intervention on the generation process is achieved through exponential penalty modifications to the token probability distributions of the large language model, mapping the theoretically continuous control variables to actionable discrete generation strategies. Experiments conducted on the nuScenes dataset using Llama3:8B demonstrate that the proposed framework outperforms existing baseline methods in collision rate, trajectory accuracy, and constraint satisfaction rate, with the overall constraint satisfaction rate improving by 7.0% over the best-performing baseline.

npj Artificial Intelligence
Macau University of Science and Technology (MO), Hong Kong University of Science and Technology (HK), Huazhong University of Science and Technology (CN), University of Hong Kong (HK)
Peace, Justice and strong institutions
Openalex Percentile: Top 2%
Reinforcement Learning in Robotics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.