A general framework for regression with mismatched data based on mixture modelling

Abstract The advent of the information age has revolutionized data collection and has led to a rapid expansion of available data sources. Methods of data integration are indispensable when a question of interest cannot be addressed using a single data source. Record linkage (RL) is at the forefront of such data integration efforts. Incentives for sharing linked data for secondary analysis have prompted the need for methodology accounting for possible errors at the RL stage. Mismatch error is a common consequence resulting from the use of nonunique or noisy identifiers at that stage. In this paper, we present a framework to enable valid postlinkage inference in the secondary analysis setting in which only the linked file is given. The proposed framework covers a variety of statistical models and can flexibly incorporate information about the underlying RL process. We propose a mixture model for linked records whose two components reflect distributions conditional on match status, i.e. correct or false match. Regarding inference, we develop a method based on composite likelihood and the expectation-maximization algorithm that is implemented in the R package pldamixture. Extensive simulations and case studies involving contemporary RL applications corroborate the effectiveness of our framework.

Authors

Institutions

Publication Details

Journal
Journal of the Royal Statistical Society Series A (Statistics in Society)
Published
2024-08-26
DOI
https://doi.org/10.1093/jrsssa/qnae083
Citations
3
Primary Topic
Data Quality and Management
Type
article
Field-Weighted Citation Impact
1.47

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A general framework for regression with mismatched data based on mixture modelling

Brady Thomas West, Guoqing Diao, Zhenbang Wang, Martin Slawski et al.
3 citations
Journal of the Royal Statistical Society Series A (Statistics in Society)
Data Quality and Management
1.47
article

A general framework for regression with mismatched data based on mixture modelling

Brady Thomas West, Guoqing Diao, Zhenbang Wang, Martin Slawski, Emanuel Ben‐David, Priyanjali Bukke
article en
3 citations

Abstract

Abstract The advent of the information age has revolutionized data collection and has led to a rapid expansion of available data sources. Methods of data integration are indispensable when a question of interest cannot be addressed using a single data source. Record linkage (RL) is at the forefront of such data integration efforts. Incentives for sharing linked data for secondary analysis have prompted the need for methodology accounting for possible errors at the RL stage. Mismatch error is a common consequence resulting from the use of nonunique or noisy identifiers at that stage. In this paper, we present a framework to enable valid postlinkage inference in the secondary analysis setting in which only the linked file is given. The proposed framework covers a variety of statistical models and can flexibly incorporate information about the underlying RL process. We propose a mixture model for linked records whose two components reflect distributions conditional on match status, i.e. correct or false match. Regarding inference, we develop a method based on composite likelihood and the expectation-maximization algorithm that is implemented in the R package pldamixture. Extensive simulations and case studies involving contemporary RL applications corroborate the effectiveness of our framework.

Journal of the Royal Statistical Society Series A (Statistics in Society)Vol. 188(3)
United States Census Bureau (US), George Mason University (US), George Washington University (US), University of Michigan (US), Statistical Research (United States) (US), Institute for Social Research (NO)
National Science Foundation, National Science Foundation of Sri Lanka
Partnerships for the goals
Openalex Percentile: Top 16%
Data Quality and Management
1.47
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.