Diffusion Maps and Sparse Reconstruction: A Two-Tier Approach to Ideal-Type Measurement

Composite indices such as V-Dem’s Electoral Democracy Index (EDI) impose a priori weights on their component indicators; potentially obscuring how political regimes vary, particularly among non-democracies. We propose a data-driven alternative that uses regime similarity, rather than deductive aggregation, to characterize variation across the EDI’s disaggregated indicators. Applying Diffusion Maps, we derive a low-dimensional embedding without imposing a priori weighting. To render this embedding interpretable, we use LASSO regression to build a sparse reconstruction: the Spectrum of Regime Similarity (SRS) that recovers most of its structure from a handful of indicators, principally opposition autonomy and election quality. Validating the SRS against intrastate conflict onset and infant mortality, we find an inverted U-shaped relationship with both outcomes that the EDI obscures, and lower predictive error than the EDI for infant mortality, with comparable performance for conflict onset. Results demonstrate that regime similarity better discriminates among non-democracies and complements concept-driven democracy measurement.

Authors

Publication Details

Journal
SocArXiv (OSF Preprints)
Published
2026-11-12
DOI
https://doi.org/10.31235/osf.io/p94z3_v1
Primary Topic
Political Conflict and Governance
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Diffusion Maps and Sparse Reconstruction: A Two-Tier Approach to Ideal-Type Measurement

Karoline Wiesner, Radost Waszkiewicz, Paula Pirker-Díaz, Matthew C. Wilson
SocArXiv (OSF Preprints)
Political Conflict and Governance
preprint

Diffusion Maps and Sparse Reconstruction: A Two-Tier Approach to Ideal-Type Measurement

Karoline Wiesner, Radost Waszkiewicz, Paula Pirker-Díaz, Matthew C. Wilson
preprint en

Abstract

Composite indices such as V-Dem’s Electoral Democracy Index (EDI) impose a priori weights on their component indicators; potentially obscuring how political regimes vary, particularly among non-democracies. We propose a data-driven alternative that uses regime similarity, rather than deductive aggregation, to characterize variation across the EDI’s disaggregated indicators. Applying Diffusion Maps, we derive a low-dimensional embedding without imposing a priori weighting. To render this embedding interpretable, we use LASSO regression to build a sparse reconstruction: the Spectrum of Regime Similarity (SRS) that recovers most of its structure from a handful of indicators, principally opposition autonomy and election quality. Validating the SRS against intrastate conflict onset and infant mortality, we find an inverted U-shaped relationship with both outcomes that the EDI obscures, and lower predictive error than the EDI for infant mortality, with comparable performance for conflict onset. Results demonstrate that regime similarity better discriminates among non-democracies and complements concept-driven democracy measurement.

SocArXiv (OSF Preprints)
Peace, justice, and strong institutions
Political Conflict and Governance
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon