Using large language models for survey research in communication: opportunities and challenges
Abstract Artificial intelligence (AI) is transforming survey research, offering powerful tools like large language models (LLMs) to analyze human beliefs, opinions, and behaviors. As researchers increasingly adopt these technologies, they face several methodological and ethical challenges. This article explores how LLMs can enhance key stages of the survey research process within communication studies while critically assessing their limitations. Through examples related to questionnaire development and open-ended response analysis, we illustrate both the promise and pitfalls of AI-assisted surveys. Furthermore, we underscore risks regarding synthetic data generation that demand further scrutiny. Thoughtful adoption, rather than uncritical enthusiasm, is essential to ensuring that LLMs strengthen, rather than undermine, the rigor and reliability of survey-based research in communication.
Authors
- Stephan Winter (ORCID: https://orcid.org/0000-0002-3403-6939)
- Sebastián Valenzuela (ORCID: https://orcid.org/0000-0001-5991-7364)
- Sebastián Rivera (ORCID: https://orcid.org/0000-0003-2642-2546)
Institutions
- Universidad Mayor (CL)
- University of Kaiserslautern (DE)
- Pontificia Universidad Católica de Chile (CL)
- Millennium Science Initiative (CL)
- Millennium Institute for Integrative Biology (CL)
- Rheinland-Pfälzische Technische Universität Kaiserslautern-Landau (DE)
Publication Details
- Journal
- Communication and Change
- Published
- 2025-10-27
- DOI
- https://doi.org/10.1007/s44382-025-00014-z
- Citations
- 1
- Primary Topic
- Computational and Text Analysis Methods
- Type
- article
- Field-Weighted Citation Impact
- 5.34
Funders
- Agenția Națională pentru Cercetare și Dezvoltare
- Agencia Nacional de Investigación y Desarrollo
- CHIST-ERA