Match Rate Is Not Match Quality

Third-party identity-resolution vendors commonly emphasize match rate, the share of submitted records they can link to identifiers for advertising activation, as their core metric of quality. Yet a high match rate does not necessarily mean that those matched identifiers belong to the submitted records (i.e., the intended targets). In this paper we explore match quality as an alternative metric to match rate, utilizing a unique data set to evaluate match quality. We are able to compare two demographics, age and gender, from a submitted record (voter files) to the same demographics in self-reported surveys matched to mobile advertising identifiers linked together by two leading identity-resolution vendors. The data and matching was from 2019-20. There is substantial ambiguity in match quality of the returned records. First, both vendors' activation files contain multiple device identifiers per match. Second, match quality among audited pairs (Vendor A) and for explicitly labeled individual-level matches (Vendor B) is only 21.8% and 23.6%, respectively. Utilizing a mixture model that assumes that correct links always agree on these two demographics and incorrect links agree 10% of the time, these rates imply conditional identity-level precisions of approximately 15% and 13%, respectively. This paper utilizes identity-resolution products that are several years old, but the question we address remains fundamental: match rate alone cannot establish whether advertisers are reaching the people they intended. Evaluating identity resolution requires independent evidence of match quality alongside match rate.

Authors

Publication Details

Journal
arXiv (Cornell University)
Published
2026-11-18
DOI
https://doi.org/10.48550/arxiv.2611.23851
Primary Topic
Data Quality and Management
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Match Rate Is Not Match Quality

David M. Rothschild, Tobias Konitzer
arXiv (Cornell University)
Data Quality and Management
preprint

Match Rate Is Not Match Quality

David M. Rothschild, Tobias Konitzer
preprint en

Abstract

Third-party identity-resolution vendors commonly emphasize match rate, the share of submitted records they can link to identifiers for advertising activation, as their core metric of quality. Yet a high match rate does not necessarily mean that those matched identifiers belong to the submitted records (i.e., the intended targets). In this paper we explore match quality as an alternative metric to match rate, utilizing a unique data set to evaluate match quality. We are able to compare two demographics, age and gender, from a submitted record (voter files) to the same demographics in self-reported surveys matched to mobile advertising identifiers linked together by two leading identity-resolution vendors. The data and matching was from 2019-20. There is substantial ambiguity in match quality of the returned records. First, both vendors' activation files contain multiple device identifiers per match. Second, match quality among audited pairs (Vendor A) and for explicitly labeled individual-level matches (Vendor B) is only 21.8% and 23.6%, respectively. Utilizing a mixture model that assumes that correct links always agree on these two demographics and incorrect links agree 10% of the time, these rates imply conditional identity-level precisions of approximately 15% and 13%, respectively. This paper utilizes identity-resolution products that are several years old, but the question we address remains fundamental: match rate alone cannot establish whether advertisers are reaching the people they intended. Evaluating identity resolution requires independent evidence of match quality alongside match rate.

arXiv (Cornell University)
Data Quality and Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon