Analyzing Coarsened and Missing Data by Imputation Methods

In various missing data problems, values are not entirely missing, but are coarsened. For coarsened observations, instead of observing the true value, a subset of values - strictly smaller than the full sample space of the variable - is observed to which the true value belongs. In our motivating example for patients with endometrial carcinoma, the degree of lymphovascular space invasion (LVSI) can be either absent, focally present, or substantially present. For a subset of individuals, however, LVSI is reported as being present, which includes both non-absent options. In the analysis of such a dataset, difficulties arise when coarsened observations are to be used in an imputation procedure. To our knowledge, no clear-cut method has been described in the literature on how to handle an observed subset of values, and treating them as entirely missing could lead to biased estimates. Therefore, in this paper, we evaluated the best strategy to deal with coarsened and missing data in multiple imputation. We tested a number of plausible ad hoc approaches, possibly already in use by statisticians. Additionally, we propose a principled approach to this problem, consisting of an adaptation of the SMC-FCS algorithm (SMC-FCS <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:semantics> <mml:mrow><mml:msub><mml:mo> </mml:mo> <mml:mrow><mml:mtext>CoCo</mml:mtext></mml:mrow> </mml:msub> </mml:mrow> <mml:annotation>$$ {}_{\mathrm{CoCo}} $$</mml:annotation></mml:semantics> </mml:math> : Coarsening compatible), that ensures that imputed values adhere to the coarsening information. These methods were compared in a simulation study. This comparison shows that methods that prevent imputations of incompatible values, like the SMC-FCS <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:semantics> <mml:mrow><mml:msub><mml:mo> </mml:mo> <mml:mrow><mml:mtext>CoCo</mml:mtext></mml:mrow> </mml:msub> </mml:mrow> <mml:annotation>$$ {}_{\mathrm{CoCo}} $$</mml:annotation></mml:semantics> </mml:math> method, perform consistently better in terms of a lower bias and RMSE, and achieve better coverage than methods that ignore coarsening or handle it in a more naïve way. The analysis of the motivating example shows that the way the coarsening information is handled can matter substantially, leading to different conclusions across methods. Overall, our proposed SMC-FCS <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:semantics> <mml:mrow><mml:msub><mml:mo> </mml:mo> <mml:mrow><mml:mtext>CoCo</mml:mtext></mml:mrow> </mml:msub> </mml:mrow> <mml:annotation>$$ {}_{\mathrm{CoCo}} $$</mml:annotation></mml:semantics> </mml:math> method outperforms other methods in handling coarsened data, requires limited additional computation cost and is easily extendable to other scenarios.

Authors

Institutions

Publication Details

Journal
Statistics in Medicine
Published
2025-03-05
DOI
https://doi.org/10.1002/sim.70032
Primary Topic
Statistical Methods and Bayesian Inference
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Analyzing Coarsened and Missing Data by Imputation Methods

Jonathan William Bartlett, Liesbeth C. de Wreede, Tjalling Bosse, Hein Putter et al.
Statistics in Medicine
Statistical Methods and Bayesian Inference
article

Analyzing Coarsened and Missing Data by Imputation Methods

Jonathan William Bartlett, Liesbeth C. de Wreede, Tjalling Bosse, Hein Putter, Nanda Horeweg, Stefan Böhringer, Lars L. J. van der Burg
article en

Abstract

In various missing data problems, values are not entirely missing, but are coarsened. For coarsened observations, instead of observing the true value, a subset of values - strictly smaller than the full sample space of the variable - is observed to which the true value belongs. In our motivating example for patients with endometrial carcinoma, the degree of lymphovascular space invasion (LVSI) can be either absent, focally present, or substantially present. For a subset of individuals, however, LVSI is reported as being present, which includes both non-absent options. In the analysis of such a dataset, difficulties arise when coarsened observations are to be used in an imputation procedure. To our knowledge, no clear-cut method has been described in the literature on how to handle an observed subset of values, and treating them as entirely missing could lead to biased estimates. Therefore, in this paper, we evaluated the best strategy to deal with coarsened and missing data in multiple imputation. We tested a number of plausible ad hoc approaches, possibly already in use by statisticians. Additionally, we propose a principled approach to this problem, consisting of an adaptation of the SMC-FCS algorithm (SMC-FCS <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:semantics> <mml:mrow><mml:msub><mml:mo> </mml:mo> <mml:mrow><mml:mtext>CoCo</mml:mtext></mml:mrow> </mml:msub> </mml:mrow> <mml:annotation>$$ {}_{\mathrm{CoCo}} $$</mml:annotation></mml:semantics> </mml:math> : Coarsening compatible), that ensures that imputed values adhere to the coarsening information. These methods were compared in a simulation study. This comparison shows that methods that prevent imputations of incompatible values, like the SMC-FCS <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:semantics> <mml:mrow><mml:msub><mml:mo> </mml:mo> <mml:mrow><mml:mtext>CoCo</mml:mtext></mml:mrow> </mml:msub> </mml:mrow> <mml:annotation>$$ {}_{\mathrm{CoCo}} $$</mml:annotation></mml:semantics> </mml:math> method, perform consistently better in terms of a lower bias and RMSE, and achieve better coverage than methods that ignore coarsening or handle it in a more naïve way. The analysis of the motivating example shows that the way the coarsening information is handled can matter substantially, leading to different conclusions across methods. Overall, our proposed SMC-FCS <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:semantics> <mml:mrow><mml:msub><mml:mo> </mml:mo> <mml:mrow><mml:mtext>CoCo</mml:mtext></mml:mrow> </mml:msub> </mml:mrow> <mml:annotation>$$ {}_{\mathrm{CoCo}} $$</mml:annotation></mml:semantics> </mml:math> method outperforms other methods in handling coarsened data, requires limited additional computation cost and is easily extendable to other scenarios.

Statistics in MedicineVol. 44(6)
Leiden University (NL), Leiden University Medical Center (NL), London School of Hygiene & Tropical Medicine (GB), Deutsche Knochenmarkspenderdatei (DE)
Openalex Percentile: Top 95%
Statistical Methods and Bayesian Inference
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.