Data poisoning in LLM multiagent societies: Social proof drives collective decision failure in financial deliberation

Abstract Large language model (LLM) multiagent systems are increasingly deployed for high‐stakes financial deliberation, but individually secure LLMs may become vulnerable when embedded in a peer‐to‐peer agent society. We study data poisoning in such societies using Moltbook, a deliberation test bed modeled after the agent‐only social platform. A single malicious agent representing just 14% of a seven‐agent society drives collective accuracy from 87.5% to 52.5%—not through prompt injection or technical exploits, but through social proof: After building peer trust, it injects fabricated data, inducing either cognitive infection, where defenders adopt the incorrect decision, or paralysis, where they abandon their judgment. Ablations across topologies and model families show that the collapse is structural rather than model‐specific. Our system‐level defense publicly tags claims untraceable to the official record, severing unwarranted trust transfer and restoring accuracy to 85.8%. Securing LLM multiagent systems requires system‐level verification, not individual prompt alignment.

Authors

Institutions

Publication Details

Journal
ETRI Journal
Published
2026-09-12
DOI
https://doi.org/10.4218/etrij.2026-0186
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Data poisoning in LLM multiagent societies: Social proof drives collective decision failure in financial deliberation

Moohong Min, Yuji Lim, Geonwoo Kim, Jeongsu Park et al.
ETRI Journal
Ethics and Social Impacts of AI
article

Data poisoning in LLM multiagent societies: Social proof drives collective decision failure in financial deliberation

Moohong Min, Yuji Lim, Geonwoo Kim, Jeongsu Park, Taehyeon Yun
article en

Abstract

Abstract Large language model (LLM) multiagent systems are increasingly deployed for high‐stakes financial deliberation, but individually secure LLMs may become vulnerable when embedded in a peer‐to‐peer agent society. We study data poisoning in such societies using Moltbook, a deliberation test bed modeled after the agent‐only social platform. A single malicious agent representing just 14% of a seven‐agent society drives collective accuracy from 87.5% to 52.5%—not through prompt injection or technical exploits, but through social proof: After building peer trust, it injects fabricated data, inducing either cognitive infection, where defenders adopt the incorrect decision, or paralysis, where they abandon their judgment. Ablations across topologies and model families show that the collapse is structural rather than model‐specific. Our system‐level defense publicly tags claims untraceable to the official record, severing unwarranted trust transfer and restoring accuracy to 85.8%. Securing LLM multiagent systems requires system‐level verification, not individual prompt alignment.

ETRI Journal
Sungkyunkwan University (KR)
Korea Institute of Science and Technology, Korea Institute of Science and Technology Information, Ministry of Science and ICT, South Korea, Korean National Police Agency
Openalex Percentile: Top 7%
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.