From the fluency fallacy to the micro-to-macro validity gap: opportunities and pitfalls of LLMs in social simulation

The integration of Large Language Models (LLMs) into social simulation has generated considerable enthusiasm, but also raises substantial methodological and epistemological challenges. This critical review examines the use of LLMs as cognitive or decision-making components of simulated agents from a computational social science perspective. Rather than treating the psychological evaluation of LLMs as separate from simulation mechanics, we argue that their behavioral and epistemic limitations can become systemic vulnerabilities when scaled to multi-agent societies. We first map the rapidly evolving landscape of LLM-driven platforms, ranging from small narrative sandboxes to population-scale and spatially structured simulations. We then develop a unified critical framework for analyzing the Micro-to-Macro Validity Gap: the propagation, nonlinear amplification, or convergent contraction of micro-level limitations—including hallucinations, stochastic inconsistency, representational biases, and alignment effects—into agent-level distortions (such as average persona convergence) and macro-level risks (such as artificial consensus and behavioral homogenization), while exposing evaluators to epistemic vulnerabilities such as the Fluency Fallacy and automation bias. We identify contexts in which LLM-based agents offer genuine operational value, including serious games, participatory environments, and exploratory modeling, while distinguishing these uses from confirmatory research with unconstrained models and precise social forecasting. Finally, we examine theory-driven hybrid architectures that embed LLMs within explicit, mechanistic, and reproducible Agent-Based modeling (ABM) frameworks. We argue that such architectures offer a promising but not sufficient path toward improving epistemic control: their validity depends on multi-level evaluation of environmental dynamics, individual behavior, cross-level interactions, and aggregate outcomes, and they remain vulnerable to the risk of physics washing.

Authors

Institutions

Publication Details

Journal
Frontiers in Artificial Intelligence
Published
2026-11-17
DOI
https://doi.org/10.3389/frai.2026.1988865
Citations
39
Primary Topic
Multi-Agent Systems and Negotiation
Type
article
Field-Weighted Citation Impact
37.04

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

From the fluency fallacy to the micro-to-macro validity gap: opportunities and pitfalls of LLMs in social simulation

Patrick Taillandier, Benoît Gaudou, Arnaud Grignard, Jean‐Daniel Zucker et al.
39 citations
Frontiers in Artificial Intelligence
Multi-Agent Systems and Negotiation
37.04
article

From the fluency fallacy to the micro-to-macro validity gap: opportunities and pitfalls of LLMs in social simulation

Patrick Taillandier, Benoît Gaudou, Arnaud Grignard, Jean‐Daniel Zucker, Alexis Drogoul, Nghi Quang Huynh
article en
39 citations

Abstract

The integration of Large Language Models (LLMs) into social simulation has generated considerable enthusiasm, but also raises substantial methodological and epistemological challenges. This critical review examines the use of LLMs as cognitive or decision-making components of simulated agents from a computational social science perspective. Rather than treating the psychological evaluation of LLMs as separate from simulation mechanics, we argue that their behavioral and epistemic limitations can become systemic vulnerabilities when scaled to multi-agent societies. We first map the rapidly evolving landscape of LLM-driven platforms, ranging from small narrative sandboxes to population-scale and spatially structured simulations. We then develop a unified critical framework for analyzing the Micro-to-Macro Validity Gap: the propagation, nonlinear amplification, or convergent contraction of micro-level limitations—including hallucinations, stochastic inconsistency, representational biases, and alignment effects—into agent-level distortions (such as average persona convergence) and macro-level risks (such as artificial consensus and behavioral homogenization), while exposing evaluators to epistemic vulnerabilities such as the Fluency Fallacy and automation bias. We identify contexts in which LLM-based agents offer genuine operational value, including serious games, participatory environments, and exploratory modeling, while distinguishing these uses from confirmatory research with unconstrained models and precise social forecasting. Finally, we examine theory-driven hybrid architectures that embed LLMs within explicit, mechanistic, and reproducible Agent-Based modeling (ABM) frameworks. We argue that such architectures offer a promising but not sufficient path toward improving epistemic control: their validity depends on multi-level evaluation of environmental dynamics, individual behavior, cross-level interactions, and aggregate outcomes, and they remain vulnerable to the risk of physics washing.

Frontiers in Artificial IntelligenceVol. 9
Université Toulouse III - Paul Sabatier (FR), Can Tho University (VN), Thuyloi University (VN), Université Toulouse-I-Capitole (FR), Sorbonne Université (FR), Institut National de Recherche pour l'Agriculture, l'Alimentation et l'Environnement (FR), Département mathématiques, informatique, sciences de la donnée et technologies du numérique (FR), Institut de Recherche en Informatique de Toulouse (FR), Université Toulouse - Jean Jaurès (FR), Unité de Modélisation Mathématique et Informatique des Systèmes Complexes (FR), Institut Polytechnique de Bordeaux (FR), Institut de Recherche pour le Développement (FR), Université de Toulouse (FR), Université Toulouse Capitole (FR), Mathématiques et Informatique Appliquées Toulouse (FR)
Agence Nationale de la Recherche
Openalex Percentile: Top 0%
Multi-Agent Systems and Negotiation
37.04
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon