NetSafe: Exploring the Topological Safety of Multi-agent System
Large language models (LLMs) have fueled significant progress in intelligent Multi-agent Systems (MAS), with expanding academic and industrial applications.However, safeguarding these systems from malicious queries receives relatively little attention, while methods for single-agent safety are challenging to transfer.In this paper, we explore MAS safety from a topological perspective, aiming at identifying structural properties that enhance security.To this end, we propose NetSafe framework, unifying diverse MAS workflows via iterative RelCom interactions to enable generalized analysis.We identify several critical phenomena for MAS under attacks (misinformation, bias, and harmful content), termed as Agent Hallucination, Aggregation Safety and Security Bottleneck.Furthermore, we verify that highly connected and larger systems are more vulnerable to adversarial spread, with task performance in a Star Graph Topology decreasing by 29.7%.In conclusion, our work introduces a new perspective on MAS safety and discovers unreported phenomena, offering insights and posing challenges to the community.Codes are available at https://github.com/Ymm-cll/NetSafe.
Authors
- Shilong Wang (ORCID: https://orcid.org/0009-0009-3928-6580)
- Qingsong Wen (ORCID: https://orcid.org/0000-0003-4516-2524)
- Qijiong Liu
- Junyuan Mao (ORCID: https://orcid.org/0009-0001-3450-0885)
- Miao Yu (ORCID: https://orcid.org/0009-0008-3981-7284)
- Chunhua Yin (ORCID: https://orcid.org/0000-0002-5067-2951)
- Yang Wang (ORCID: https://orcid.org/0000-0001-7805-2861)
- Guibin Zhang (ORCID: https://orcid.org/0009-0001-6405-3289)
- Kun Wang (ORCID: https://orcid.org/0009-0006-7995-3796)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.findings-acl.150
- Citations
- 1
- Primary Topic
- Smart Grid Security and Resilience
- Type
- article
- Field-Weighted Citation Impact
- 1.21
Funders
- National Natural Science Foundation of China