Can large language models complement tourism surveys?
Tourism research relies heavily on surveys, yet declining response rates challenge data collection. Large language models offer a potential alternative for approximating human responses. This study compares four prompting techniques using ChatGPT-4o. At the mean level, chain-of-thought and role-based prompting showed limited alignment with human data, while bias mitigation yielded slight improvement. N-shot learning achieved the strongest mean-level alignment, although performance varied across measures. Analyses of variance, skewness, and kurtosis showed that no prompting technique consistently reproduced human response distributions. These findings identify important boundary conditions: large language models may approximate the “average respondent” on specific measures but fail to capture broader distributional properties, supporting their potential use for early-stage pretesting and screening rather than inference-driven research.
Authors
- Sara Dolničar (ORCID: https://orcid.org/0000-0001-5176-3161)
- Anna Kristina Zinn (ORCID: https://orcid.org/0000-0002-3631-0372)
- Marius Portmann (ORCID: https://orcid.org/0000-0003-1852-3961)
- Vijaya Sarmishtha Kaza
- Qingqing Chen
Institutions
- University of Primorska (SI)
- The University of Queensland (AU)
Publication Details
- Journal
- Annals of Tourism Research
- Published
- 2026-10-28
- DOI
- https://doi.org/10.1016/j.annals.2026.104312
- Primary Topic
- Survey Methodology and Nonresponse
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Australian Research Council