RESEARCH SYNTHESIS -- LLM-Based Simulations of Survey Responses: A Systematic Literature Review and Synthesis of Methods
Large language models (LLMs) are increasingly used in survey research, including to predict, simulate, or impute responses. Despite a rapidly growing interest in applications to create synthetic survey data, the empirical evidence remains fragmented, with substantial variation in research objectives, model architectures, ``persona'' construction strategies, and validation practices. This paper presents a systematic review of 55 studies published between 2022 and 2025 that use LLMs to generate, predict, or impute responses in survey and related attitudinal or behavioral data. The results suggest that LLM-based survey simulation is best understood as a conditional, use-case-specific tool rather than a general substitute for traditional imputation methods and human respondents. We outline concrete steps toward a more coherent evaluation framework, including use-case-specific metric selection, relational alignment as a standard validity check, and greater transparency in model and design choices.
Authors
- Sebastian Stier (ORCID: https://orcid.org/0000-0002-1217-5778)
- Claudia Wagner (ORCID: https://orcid.org/0000-0002-0640-8221)
- Dennis Assenmacher (ORCID: https://orcid.org/0000-0001-9219-1956)
- Hao Ting Chan (ORCID: https://orcid.org/0009-0000-0781-8014)
Publication Details
- Published
- 2026-10-28
- DOI
- https://doi.org/10.31235/osf.io/fy4az_v1
- Primary Topic
- Survey Methodology and Nonresponse
- Type
- preprint