How Accurate Are Survey Measurements of Objective Phenomena?
Abstract How accurate are survey measurements of phenomena that can be objectively verified? This article reports a review of various types of evidence assessing accuracy (vs. benchmarks not derived from self-reports) across a wide spectrum of content areas, including demographics, healthcare, labor force statistics, substance use and more. The vast majority of measurements were accurate, according to three assessment methods. Individual respondents’ self-reports closely matched objective records of the same phenomena for the same individual. Small aggregate differences were observed between survey sample means and aggregate means derived from objective records. Self-reports correlated strongly with measures of the same attributes of those individuals from secondary data not based on self-reports. Taken together, the evidence suggests that survey measurements of objective phenomena are highly accurate.
Authors
- Amanda Scott (ORCID: https://orcid.org/0000-0001-7035-1402)
- Elizabeth Mitchell Elder (ORCID: https://orcid.org/0000-0002-9741-5012)
- Jon A. Krosnick (ORCID: https://orcid.org/0000-0003-0336-1613)
- David J. Chapman (ORCID: https://orcid.org/0000-0003-0654-4730)
- Lisanne Wichgers (ORCID: https://orcid.org/0000-0002-8960-3611)
- Elizabeth Quinlan (ORCID: https://orcid.org/0000-0003-0267-0414)
- LinChiat Chang
- Matt Berent
- Elaine Albertson
Institutions
- Stanford University (US)
Publication Details
- Journal
- Political Analysis
- Published
- 2026-11-04
- DOI
- https://doi.org/10.1017/pan.2026.10054
- Primary Topic
- Survey Methodology and Nonresponse
- Type
- article
- Field-Weighted Citation Impact
- 0.00