A deterministic framework for linkage of infectious disease surveillance and national mortality records: development and validation using tuberculosis surveillance data

Background: Linkage of infectious-disease surveillance data to mortality records is important for estimating long-term outcomes, but incomplete personal identifiers present methodological challenges. We developed and validated a deterministic linkage framework for linking the National Tuberculosis Surveillance System (NTBS) with Office for National Statistics (ONS) mortality records. Methods: TB notifications in England from 2001 to 2024 were linked to ONS mortality records using 12 sequential matching rules based on combinations of NHS number, date of birth, name, postcode, sex and phonetic matching. Linkage outputs underwent person level deduplication and clerical review. Precision and recall were estimated, and potential linkage bias assessed by variation in identifier completeness and linkage success. Confirmed false-positive links identified during validation were removed from the analytical dataset. Results: Among 151,965 TB notifications, 28,060 initial links were identified. Following deduplication, validation and refinement, 26,937 linked notifications were retained. Estimated precision increased from 97.7% to 99.2% (95% CI 96-100.0) following removal of false-positive links; estimated recall was 98.1% (95% CI 95.4-98.6%). More than 90% of links used NHS-number-based match keys. PDS enrichment increased NHS-number availability and enabled additional NHS-number-based links, although a small proportion linked to different ONS records following enrichment. NHS number availability and linkage success differed across demographic and social groups, demonstrating differential linkage. Conclusions: A hierarchical deterministic approach combined with targeted validation achieved high linkage accuracy while identifying and addressing differential linkage. This provides a transparent framework for future NTBS-ONS linkage and may be adaptable to other surveillance systems where comparable identifiers are available.

Authors

Institutions

Publication Details

Journal
medRxiv
Published
2026-11-15
DOI
https://doi.org/10.64898/2026.11.12.26367852
Primary Topic
Data Quality and Management
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

A deterministic framework for linkage of infectious disease surveillance and national mortality records: development and validation using tuberculosis surveillance data

Manish Pareek, Sharon Elizabeth Cox, Ailva O’Reilly, Dominik Zenner et al.
medRxiv
Data Quality and Management
preprint

A deterministic framework for linkage of infectious disease surveillance and national mortality records: development and validation using tuberculosis surveillance data

Manish Pareek, Sharon Elizabeth Cox, Ailva O’Reilly, Dominik Zenner, Jamilah Z Meghji, Orla Presslie
preprint en

Abstract

Background: Linkage of infectious-disease surveillance data to mortality records is important for estimating long-term outcomes, but incomplete personal identifiers present methodological challenges. We developed and validated a deterministic linkage framework for linking the National Tuberculosis Surveillance System (NTBS) with Office for National Statistics (ONS) mortality records. Methods: TB notifications in England from 2001 to 2024 were linked to ONS mortality records using 12 sequential matching rules based on combinations of NHS number, date of birth, name, postcode, sex and phonetic matching. Linkage outputs underwent person level deduplication and clerical review. Precision and recall were estimated, and potential linkage bias assessed by variation in identifier completeness and linkage success. Confirmed false-positive links identified during validation were removed from the analytical dataset. Results: Among 151,965 TB notifications, 28,060 initial links were identified. Following deduplication, validation and refinement, 26,937 linked notifications were retained. Estimated precision increased from 97.7% to 99.2% (95% CI 96-100.0) following removal of false-positive links; estimated recall was 98.1% (95% CI 95.4-98.6%). More than 90% of links used NHS-number-based match keys. PDS enrichment increased NHS-number availability and enabled additional NHS-number-based links, although a small proportion linked to different ONS records following enrichment. NHS number availability and linkage success differed across demographic and social groups, demonstrating differential linkage. Conclusions: A hierarchical deterministic approach combined with targeted validation achieved high linkage accuracy while identifying and addressing differential linkage. This provides a transparent framework for future NTBS-ONS linkage and may be adaptable to other surveillance systems where comparable identifiers are available.

medRxiv
University of Leicester (GB), Queen Mary University of London (GB), UK Health Security Agency (GB), Imperial College London (GB)
Data Quality and Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon