Social media sampling is an effective way to access hard to survey populations and low prevalence groups

Non-probability samples have become increasingly popular despite some criticism. This paper examines social media sampling as a tool for accessing hard-to-survey populations. Our study targeted individuals in Germany using ads on Facebook and X, yielding 4,590 respondents. We compared these samples with high-quality probability samples (SOEP, ESS) through measurement equivalence analysis of shared measures between samples. Results show that our social media sampling strategy yielded effective sample sizes for our target population that exceeded those from SOEP and ESS by ratios between 2:1 and 5:1. Our findings suggest that non-probability sampling can be a viable method for researchers examining relational patterns among variables in hard-to-survey populations. Because we observe varying levels of measurement equivalence, rigorous methodological strategies for post-hoc analyses are recommended. We propose measurement equivalence analysis as a post-hoc assessment strategy to quantify the analytical effectiveness of the employed sampling strategy.

Authors

Institutions

Publication Details

Journal
International Journal of Social Research Methodology
Published
2025-10-15
DOI
https://doi.org/10.1080/13645579.2025.2564866
Citations
3
Primary Topic
Social Media in Health Education
Type
article
Field-Weighted Citation Impact
6.50

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Social media sampling is an effective way to access hard to survey populations and low prevalence groups

Thorsten Faas, Denis Gerstorf, Swen Hutter, Christian von Scheve et al.
3 citations
International Journal of Social Research Methodology
Social Media in Health Education
6.50
article

Social media sampling is an effective way to access hard to survey populations and low prevalence groups

Thorsten Faas, Denis Gerstorf, Swen Hutter, Christian von Scheve, Hannah Helal, David Schieferdecker, Jannes Jacobsen, Jule Specht, Hanna Schwander, Dennis Klinke, Manuel Dierse
article en
3 citations

Abstract

Non-probability samples have become increasingly popular despite some criticism. This paper examines social media sampling as a tool for accessing hard-to-survey populations. Our study targeted individuals in Germany using ads on Facebook and X, yielding 4,590 respondents. We compared these samples with high-quality probability samples (SOEP, ESS) through measurement equivalence analysis of shared measures between samples. Results show that our social media sampling strategy yielded effective sample sizes for our target population that exceeded those from SOEP and ESS by ratios between 2:1 and 5:1. Our findings suggest that non-probability sampling can be a viable method for researchers examining relational patterns among variables in hard-to-survey populations. Because we observe varying levels of measurement equivalence, rigorous methodological strategies for post-hoc analyses are recommended. We propose measurement equivalence analysis as a post-hoc assessment strategy to quantify the analytical effectiveness of the employed sampling strategy.

International Journal of Social Research Methodology
WZB Berlin Social Science Center (DE), Humboldt-Universität zu Berlin (DE), The Expert Council of German Foundations on Integration and Migration (DE), Freie Universität Berlin (DE)
Berlin University Alliance
Openalex Percentile: Top 3%
Social Media in Health Education
6.50
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.