Data poisoning in LLM multiagent societies: Social proof drives collective decision failure in financial deliberation
Abstract Large language model (LLM) multiagent systems are increasingly deployed for high‐stakes financial deliberation, but individually secure LLMs may become vulnerable when embedded in a peer‐to‐peer agent society. We study data poisoning in such societies using Moltbook, a deliberation test bed modeled after the agent‐only social platform. A single malicious agent representing just 14% of a seven‐agent society drives collective accuracy from 87.5% to 52.5%—not through prompt injection or technical exploits, but through social proof: After building peer trust, it injects fabricated data, inducing either cognitive infection, where defenders adopt the incorrect decision, or paralysis, where they abandon their judgment. Ablations across topologies and model families show that the collapse is structural rather than model‐specific. Our system‐level defense publicly tags claims untraceable to the official record, severing unwarranted trust transfer and restoring accuracy to 85.8%. Securing LLM multiagent systems requires system‐level verification, not individual prompt alignment.
Authors
- Moohong Min (ORCID: https://orcid.org/0000-0001-8979-1344)
- Yuji Lim (ORCID: https://orcid.org/0009-0009-1595-5532)
- Geonwoo Kim (ORCID: https://orcid.org/0009-0007-1567-9107)
- Jeongsu Park (ORCID: https://orcid.org/0009-0001-6846-1095)
- Taehyeon Yun (ORCID: https://orcid.org/0009-0000-2380-7008)
Institutions
- Sungkyunkwan University (KR)
Publication Details
- Journal
- ETRI Journal
- Published
- 2026-09-12
- DOI
- https://doi.org/10.4218/etrij.2026-0186
- Primary Topic
- Ethics and Social Impacts of AI
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Korea Institute of Science and Technology
- Korea Institute of Science and Technology Information
- Ministry of Science and ICT, South Korea
- Korean National Police Agency