How ethnic name variations influence data linkage results: A population level study using public voter databases

ObjectivesIt has been shown that record linkage methods can induce bias in resulting datasets since the linkage quality may differ between ethno-racial groups. In this project, we used publicly available voter databases to investigate whether ethno-racial attributes can influence the similarities calculated using approximate string comparison functions on voters' names. ApproachWe used 11 annual snapshots of a publicly available US voter database between 2011 and 2021 with uniquely identifiable voter data. We extracted pairs of the same voter’s first and last name values from two consecutive snapshots where these values differ. We calculated string similarities and created similarity histograms for each of the available ethno-racial categories, and other sociodemographics variables such as gender and age. We characterized common patterns of name disagreements by ethno-racial groups and compared the shapes of these histograms using cumulative density distributions. Preliminary ResultsAcross the 10 snapshot pairs, eligible voters with non-missing first and last names are included (N2011/2012 = 6,193,001, N2020/2021 = 7,852,763), describing 124,009 first name changes and 485,807 last name changes. Results will be presented as a series of density plots. Using Jaro-Winkler similarity scores of 0.7, 0.8 and 0.9 as threshold, we examined whether match rates differ by ethno-racial categories. Conclusions and ImplicationsUsing the same string similarity function on names of individuals of different ethno-racial groups may lead to different distributions of the resulting similarity values. Understanding the patterns of ethno-racial-based name changes in your particular dataset is crucial on selecting linkage parameters that would minimise ethno-racial bias.

Authors

Institutions

Publication Details

Journal
International Journal for Population Data Science
Published
2024-09-10
DOI
https://doi.org/10.23889/ijpds.v9i5.2590
Primary Topic
Data Quality and Management
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

How ethnic name variations influence data linkage results: A population level study using public voter databases

Rainer Schnell, Peter Christen, Sumayya Ziyad, Joseph Lam
International Journal for Population Data Science
Data Quality and Management
article

How ethnic name variations influence data linkage results: A population level study using public voter databases

Rainer Schnell, Peter Christen, Sumayya Ziyad, Joseph Lam
article en

Abstract

ObjectivesIt has been shown that record linkage methods can induce bias in resulting datasets since the linkage quality may differ between ethno-racial groups. In this project, we used publicly available voter databases to investigate whether ethno-racial attributes can influence the similarities calculated using approximate string comparison functions on voters' names. ApproachWe used 11 annual snapshots of a publicly available US voter database between 2011 and 2021 with uniquely identifiable voter data. We extracted pairs of the same voter’s first and last name values from two consecutive snapshots where these values differ. We calculated string similarities and created similarity histograms for each of the available ethno-racial categories, and other sociodemographics variables such as gender and age. We characterized common patterns of name disagreements by ethno-racial groups and compared the shapes of these histograms using cumulative density distributions. Preliminary ResultsAcross the 10 snapshot pairs, eligible voters with non-missing first and last names are included (N2011/2012 = 6,193,001, N2020/2021 = 7,852,763), describing 124,009 first name changes and 485,807 last name changes. Results will be presented as a series of density plots. Using Jaro-Winkler similarity scores of 0.7, 0.8 and 0.9 as threshold, we examined whether match rates differ by ethno-racial categories. Conclusions and ImplicationsUsing the same string similarity function on names of individuals of different ethno-racial groups may lead to different distributions of the resulting similarity values. Understanding the patterns of ethno-racial-based name changes in your particular dataset is crucial on selecting linkage parameters that would minimise ethno-racial bias.

International Journal for Population Data ScienceVol. 9(5)
Australian National University (AU), Great Ormond Street Hospital (GB), University College London (GB), University of Duisburg-Essen (DE)
Economic and Social Research Council
Openalex Percentile: Top 82%
Data Quality and Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.