Quantity or quality? Comparing social media data sampling strategies for government crisis communication research

Social media platforms are popular data sources for communication research, with X (formerly Twitter) being the most commonly used. However, strategies for high-quality social media data collection that form the cornerstone of rigorous research are rarely discussed or evaluated. In this paper, we use a case study of government crisis communication during Covid-19 in Germany and Italy to compare deductive and inductive sampling strategies on X in two different timeframes. We used different metrics (Jaccard index, precision, and recall) and different comparisons (relevant users and content, top users and terms, and tweeting frequency over time) to analyze which sampling strategy would provide high-quality data for research. Our results revealed that the deductive sampling strategy outperformed the inductive strategy in all the studied cases, this emphasizes the importance of data quality over quick access or the size of the data set. Further implications for comparative and computational research are discussed.

Authors

Institutions

Publication Details

Journal
International Journal of Disaster Risk Reduction
Published
2025-05-06
DOI
https://doi.org/10.1016/j.ijdrr.2025.105531
Citations
5
Primary Topic
Public Relations and Crisis Communication
Type
article
Field-Weighted Citation Impact
19.32

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Quantity or quality? Comparing social media data sampling strategies for government crisis communication research

Jingyuan Yu, Emese Domahidi, Nadine Steinmetz, Khaoula Benmaarouf
5 citations
International Journal of Disaster Risk Reduction
Public Relations and Crisis Communication
19.32
article

Quantity or quality? Comparing social media data sampling strategies for government crisis communication research

Jingyuan Yu, Emese Domahidi, Nadine Steinmetz, Khaoula Benmaarouf
article en
5 citations

Abstract

Social media platforms are popular data sources for communication research, with X (formerly Twitter) being the most commonly used. However, strategies for high-quality social media data collection that form the cornerstone of rigorous research are rarely discussed or evaluated. In this paper, we use a case study of government crisis communication during Covid-19 in Germany and Italy to compare deductive and inductive sampling strategies on X in two different timeframes. We used different metrics (Jaccard index, precision, and recall) and different comparisons (relevant users and content, top users and terms, and tweeting frequency over time) to analyze which sampling strategy would provide high-quality data for research. Our results revealed that the deductive sampling strategy outperformed the inductive strategy in all the studied cases, this emphasizes the importance of data quality over quick access or the size of the data set. Further implications for comparative and computational research are discussed.

International Journal of Disaster Risk ReductionVol. 124
Technische Universität Ilmenau (DE), University of Erfurt (DE), University of Applied Sciences Erfurt (DE), Fraunhofer Institute for Digital Media Technology (DE)
Deutsche Forschungsgemeinschaft
Openalex Percentile: Top 1%
Public Relations and Crisis Communication
19.32
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.