A scaling law to model the effectiveness of identification techniques

AI techniques are increasingly being used to identify individuals both offline and online. However, quantifying their effectiveness at scale and, by extension, the risks they pose remains a significant challenge. Here, we propose a two-parameter Bayesian model for exact matching techniques and derive an analytical expression for correctness (κ), the fraction of people accurately identified in a population. We then generalize the model to forecast how κ scales from small-scale experiments to the real world, for exact, sparse, and machine learning-based robust identification techniques. Despite having only two degrees of freedom, our method closely fits 476 correctness curves and strongly outperforms curve-fitting methods and entropy-based rules of thumb. Our work provides a principled framework for forecasting the privacy risks posed by identification techniques, while also supporting independent accountability efforts for AI-based biometric systems.

Authors

Institutions

Publication Details

Journal
Nature Communications
Published
2025-01-09
DOI
https://doi.org/10.1038/s41467-024-55296-6
Primary Topic
Privacy-Preserving Technologies in Data
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A scaling law to model the effectiveness of identification techniques

Luc Rocher, Julien M. Hendrickx, Yves-Alexandre de Montjoye
Nature Communications
Privacy-Preserving Technologies in Data
article

A scaling law to model the effectiveness of identification techniques

Luc Rocher, Julien M. Hendrickx, Yves-Alexandre de Montjoye
article en

Abstract

AI techniques are increasingly being used to identify individuals both offline and online. However, quantifying their effectiveness at scale and, by extension, the risks they pose remains a significant challenge. Here, we propose a two-parameter Bayesian model for exact matching techniques and derive an analytical expression for correctness (κ), the fraction of people accurately identified in a population. We then generalize the model to forecast how κ scales from small-scale experiments to the real world, for exact, sparse, and machine learning-based robust identification techniques. Despite having only two degrees of freedom, our method closely fits 476 correctness curves and strongly outperforms curve-fitting methods and entropy-based rules of thumb. Our work provides a principled framework for forecasting the privacy risks posed by identification techniques, while also supporting independent accountability efforts for AI-based biometric systems.

Nature CommunicationsVol. 16(1)
University of Oxford (GB), CRUK/MRC Oxford Institute for Radiation Oncology (GB), NIHR Imperial Biomedical Research Centre (GB), Imperial College London (GB), UCLouvain (BE)
UK Research and Innovation, John Fell Fund, University of Oxford
Peace, Justice and strong institutions
Openalex Percentile: Top 100%
Privacy-Preserving Technologies in Data
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A scaling law to model the effectiveness of identification techniques — Luc Rocher, Julien M. Hendrickx, et al. · Nature Communications (2025) | TGRS Research Map | TGRS