Language model teams as distributed systems

Large language models (LLMs) are growing increasingly powerful. Yet, fundamental constraints on the reasoning, memory, and performance of individual models has sparked recent interest in scaling abilities using LLM teams. With growing deployment of LLM teams at scale, there is a need for principled guidelines for when teams help, how many agents to use, and how structure impacts performance. Rather than building these teams through trial-and-error, we propose using distributed systems as a formal foundation for designing and evaluating LLM teams. Under this formal framework, we derive predictions about how task structure and team architecture should shape performance. Empirical evidence supports these predictions: LLM team scaling follows classical distributed computing laws based on the structure of a task, and centralized and decentralized architectures exhibit the asymmetric vulnerabilities predicted by distributed systems theory. These results establish distributed computing as a generative framework that yields testable, quantitative predictions about LLM team behavior and informs the construction of more efficient and capable teams.

Authors

Institutions

Publication Details

Journal
Proceedings of the National Academy of Sciences
Published
2026-11-18
DOI
https://doi.org/10.1073/pnas.2612825123
Citations
8
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
7.74

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Language model teams as distributed systems

Ilia Sucholutsky, Natalia Vélez, Elizabeth Mieczkowski, Thomas L. Griffiths et al.
8 citations
Proceedings of the National Academy of Sciences
Topic Modeling
7.74
article

Language model teams as distributed systems

Ilia Sucholutsky, Natalia Vélez, Elizabeth Mieczkowski, Thomas L. Griffiths, Katherine M. Collins
article en
8 citations

Abstract

Large language models (LLMs) are growing increasingly powerful. Yet, fundamental constraints on the reasoning, memory, and performance of individual models has sparked recent interest in scaling abilities using LLM teams. With growing deployment of LLM teams at scale, there is a need for principled guidelines for when teams help, how many agents to use, and how structure impacts performance. Rather than building these teams through trial-and-error, we propose using distributed systems as a formal foundation for designing and evaluating LLM teams. Under this formal framework, we derive predictions about how task structure and team architecture should shape performance. Empirical evidence supports these predictions: LLM team scaling follows classical distributed computing laws based on the structure of a task, and centralized and decentralized architectures exhibit the asymmetric vulnerabilities predicted by distributed systems theory. These results establish distributed computing as a generative framework that yields testable, quantitative predictions about LLM team behavior and informs the construction of more efficient and capable teams.

Proceedings of the National Academy of SciencesVol. 123(47)
Princeton University (US), University of Cambridge (GB), New York University (US), Massachusetts Institute of Technology (US)
Templeton World Charity Foundation, Office of Naval Research, Air Force Office of Scientific Research
Openalex Percentile: Top 3%
Topic Modeling
7.74
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon