How Ethnic Name Characteristics Influence String Similarities and Cause Bias when Linking Large Population Databases

Comparing personal names is at the core of most record linkage systems, where it is common for names to be recorded with variations, either erroneous or intentional, and individuals can change their names over time. Therefore, string comparison functions are commonly employed to calculate similarities between names. Popular comparison functions include Jaro-Winkler, edit distance, and q-gram based techniques. Although the question of which functions are more suitable for a given record linkage application has received little attention, the selection of a suitable string comparison function can be crucial in the context of bias and fairness. This is particularly important when linking databases that contain ethnically diverse names. In this work, we investigate how different string comparison functions can result in various levels of bias when names from diverse ethnic groups are compared. We conduct extensive experiments on a large public population database where for each record an ethnicity is available. By comparing name variations of the same person using multiple string comparison functions, we show that different functions exhibit diverse similarity distributions for names from different ethnic groups. Moreover, the similarity score for the same name pair can vary greatly depending on the comparison function employed. Our results provide important insights into how practical record linkage of population-level databases should be conducted to limit bias with regard to ethnic groups.

Authors

Institutions

Publication Details

Journal
International Journal for Population Data Science
Published
2026-11-16
DOI
https://doi.org/10.23889/ijpds.v11i1.3767
Primary Topic
Data Quality and Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

How Ethnic Name Characteristics Influence String Similarities and Cause Bias when Linking Large Population Databases

Rainer Schnell, Peter Christen, Thilina Ranbaduge, Joseph Lam et al.
1 links
International Journal for Population Data Science
Data Quality and Management
article

How Ethnic Name Characteristics Influence String Similarities and Cause Bias when Linking Large Population Databases

Rainer Schnell, Peter Christen, Thilina Ranbaduge, Joseph Lam, Anushka Vidanage, Sumayya Ziyad, Yashithi Dharmawimala
article en

Abstract

Comparing personal names is at the core of most record linkage systems, where it is common for names to be recorded with variations, either erroneous or intentional, and individuals can change their names over time. Therefore, string comparison functions are commonly employed to calculate similarities between names. Popular comparison functions include Jaro-Winkler, edit distance, and q-gram based techniques. Although the question of which functions are more suitable for a given record linkage application has received little attention, the selection of a suitable string comparison function can be crucial in the context of bias and fairness. This is particularly important when linking databases that contain ethnically diverse names. In this work, we investigate how different string comparison functions can result in various levels of bias when names from diverse ethnic groups are compared. We conduct extensive experiments on a large public population database where for each record an ethnicity is available. By comparing name variations of the same person using multiple string comparison functions, we show that different functions exhibit diverse similarity distributions for names from different ethnic groups. Moreover, the similarity score for the same name pair can vary greatly depending on the comparison function employed. Our results provide important insights into how practical record linkage of population-level databases should be conducted to limit bias with regard to ethnic groups.

International Journal for Population Data ScienceVol. 11(1)
Australian National University (AU), Commonwealth Scientific and Industrial Research Organisation (AU), Data61 (AU), University College London (GB), University of Duisburg-Essen (DE), University of Edinburgh (GB)
Data Quality and Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon