Can large language models complement tourism surveys?

Tourism research relies heavily on surveys, yet declining response rates challenge data collection. Large language models offer a potential alternative for approximating human responses. This study compares four prompting techniques using ChatGPT-4o. At the mean level, chain-of-thought and role-based prompting showed limited alignment with human data, while bias mitigation yielded slight improvement. N-shot learning achieved the strongest mean-level alignment, although performance varied across measures. Analyses of variance, skewness, and kurtosis showed that no prompting technique consistently reproduced human response distributions. These findings identify important boundary conditions: large language models may approximate the “average respondent” on specific measures but fail to capture broader distributional properties, supporting their potential use for early-stage pretesting and screening rather than inference-driven research.

Authors

Institutions

Publication Details

Journal
Annals of Tourism Research
Published
2026-10-28
DOI
https://doi.org/10.1016/j.annals.2026.104312
Primary Topic
Survey Methodology and Nonresponse
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Can large language models complement tourism surveys?

Sara Dolničar, Anna Kristina Zinn, Marius Portmann, Vijaya Sarmishtha Kaza et al.
4 links
Annals of Tourism Research
Survey Methodology and Nonresponse
article

Can large language models complement tourism surveys?

Sara Dolničar, Anna Kristina Zinn, Marius Portmann, Vijaya Sarmishtha Kaza, Qingqing Chen
article en

Abstract

Tourism research relies heavily on surveys, yet declining response rates challenge data collection. Large language models offer a potential alternative for approximating human responses. This study compares four prompting techniques using ChatGPT-4o. At the mean level, chain-of-thought and role-based prompting showed limited alignment with human data, while bias mitigation yielded slight improvement. N-shot learning achieved the strongest mean-level alignment, although performance varied across measures. Analyses of variance, skewness, and kurtosis showed that no prompting technique consistently reproduced human response distributions. These findings identify important boundary conditions: large language models may approximate the “average respondent” on specific measures but fail to capture broader distributional properties, supporting their potential use for early-stage pretesting and screening rather than inference-driven research.

Annals of Tourism ResearchVol. 121
University of Primorska (SI), The University of Queensland (AU)
Australian Research Council
Openalex Percentile: Top 6%
Survey Methodology and Nonresponse
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon