Can social media reliably estimate unemployment?
Digital trace data hold tremendous potential for measuring policy-relevant outcomes in real-time, yet its reliability is often questioned. Here, we propose a principled yet simple approach: capturing individual disclosures of unemployment using a fine-tuned AI model and post-stratification adjustment using inferred user demographics. We show that our methodology consistently outperforms the industry's forecasting average and can improve the predictions of US unemployment insurance claims, up to 2 weeks in advance, at the national, state, and city levels at both turbulent and stable times. The results demonstrate the potential of combining AI models with statistical modeling to complement traditional survey methodology, and contribute to better-informed policymaking, especially at turbulent times.
Authors
- Manuel Tonneau (ORCID: https://orcid.org/0009-0008-4954-3133)
- Nir Grinberg (ORCID: https://orcid.org/0000-0002-1277-894X)
- Boris Sobol
- Do Lee
- Samuel P Fraiberger
Institutions
- Ben-Gurion University of the Negev (IL)
- University of Oxford (GB)
- Science Oxford (GB)
- World Bank Group (US)
- New York University (US)
Publication Details
- Journal
- PNAS Nexus
- Published
- 2025-12-01
- DOI
- https://doi.org/10.1093/pnasnexus/pgaf309
- Primary Topic
- Data-Driven Disease Surveillance
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- World Bank Group