Using large language models for survey research in communication: opportunities and challenges

Abstract Artificial intelligence (AI) is transforming survey research, offering powerful tools like large language models (LLMs) to analyze human beliefs, opinions, and behaviors. As researchers increasingly adopt these technologies, they face several methodological and ethical challenges. This article explores how LLMs can enhance key stages of the survey research process within communication studies while critically assessing their limitations. Through examples related to questionnaire development and open-ended response analysis, we illustrate both the promise and pitfalls of AI-assisted surveys. Furthermore, we underscore risks regarding synthetic data generation that demand further scrutiny. Thoughtful adoption, rather than uncritical enthusiasm, is essential to ensuring that LLMs strengthen, rather than undermine, the rigor and reliability of survey-based research in communication.

Authors

Institutions

Publication Details

Journal
Communication and Change
Published
2025-10-27
DOI
https://doi.org/10.1007/s44382-025-00014-z
Citations
1
Primary Topic
Computational and Text Analysis Methods
Type
article
Field-Weighted Citation Impact
5.34

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Using large language models for survey research in communication: opportunities and challenges

Stephan Winter, Sebastián Valenzuela, Sebastián Rivera
1 citations
Communication and Change
Computational and Text Analysis Methods
5.34
article

Using large language models for survey research in communication: opportunities and challenges

Stephan Winter, Sebastián Valenzuela, Sebastián Rivera
article en
1 citations

Abstract

Abstract Artificial intelligence (AI) is transforming survey research, offering powerful tools like large language models (LLMs) to analyze human beliefs, opinions, and behaviors. As researchers increasingly adopt these technologies, they face several methodological and ethical challenges. This article explores how LLMs can enhance key stages of the survey research process within communication studies while critically assessing their limitations. Through examples related to questionnaire development and open-ended response analysis, we illustrate both the promise and pitfalls of AI-assisted surveys. Furthermore, we underscore risks regarding synthetic data generation that demand further scrutiny. Thoughtful adoption, rather than uncritical enthusiasm, is essential to ensuring that LLMs strengthen, rather than undermine, the rigor and reliability of survey-based research in communication.

Communication and ChangeVol. 1(1)
Universidad Mayor (CL), University of Kaiserslautern (DE), Pontificia Universidad Católica de Chile (CL), Millennium Science Initiative (CL), Millennium Institute for Integrative Biology (CL), Rheinland-Pfälzische Technische Universität Kaiserslautern-Landau (DE)
Agenția Națională pentru Cercetare și Dezvoltare, Agencia Nacional de Investigación y Desarrollo, CHIST-ERA
Openalex Percentile: Top 4%
Computational and Text Analysis Methods
5.34
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.