Social media sampling is an effective way to access hard to survey populations and low prevalence groups
Non-probability samples have become increasingly popular despite some criticism. This paper examines social media sampling as a tool for accessing hard-to-survey populations. Our study targeted individuals in Germany using ads on Facebook and X, yielding 4,590 respondents. We compared these samples with high-quality probability samples (SOEP, ESS) through measurement equivalence analysis of shared measures between samples. Results show that our social media sampling strategy yielded effective sample sizes for our target population that exceeded those from SOEP and ESS by ratios between 2:1 and 5:1. Our findings suggest that non-probability sampling can be a viable method for researchers examining relational patterns among variables in hard-to-survey populations. Because we observe varying levels of measurement equivalence, rigorous methodological strategies for post-hoc analyses are recommended. We propose measurement equivalence analysis as a post-hoc assessment strategy to quantify the analytical effectiveness of the employed sampling strategy.
Authors
- Thorsten Faas (ORCID: https://orcid.org/0000-0003-3192-1155)
- Denis Gerstorf (ORCID: https://orcid.org/0000-0002-2133-9498)
- Swen Hutter (ORCID: https://orcid.org/0000-0002-1107-1213)
- Christian von Scheve (ORCID: https://orcid.org/0000-0003-4296-6623)
- Hannah Helal
- David Schieferdecker (ORCID: https://orcid.org/0000-0003-2376-0929)
- Jannes Jacobsen (ORCID: https://orcid.org/0000-0003-4358-0458)
- Jule Specht (ORCID: https://orcid.org/0000-0003-2840-697X)
- Hanna Schwander (ORCID: https://orcid.org/0000-0002-0352-7620)
- Dennis Klinke
- Manuel Dierse
Institutions
- WZB Berlin Social Science Center (DE)
- Humboldt-Universität zu Berlin (DE)
- The Expert Council of German Foundations on Integration and Migration (DE)
- Freie Universität Berlin (DE)
Publication Details
- Journal
- International Journal of Social Research Methodology
- Published
- 2025-10-15
- DOI
- https://doi.org/10.1080/13645579.2025.2564866
- Citations
- 3
- Primary Topic
- Social Media in Health Education
- Type
- article
- Field-Weighted Citation Impact
- 6.50
Funders
- Berlin University Alliance