Identifying data anomalies in milk component measurements from partial-day milking records
High-quality milk and milk component data are crucial for accurate genetic evaluations and effective herd management. However, data recording errors can compromise the validity of downstream decisions. In a recent study, we proposed using intraclass correlation coefficients as a herd-level metric to assess the consistency of milk components from single milkings, thereby effectively identifying farms with potential data quality concerns. A key challenge, however, is whether potentially erroneous records can be detected at the cow-day level. In this study, we introduce a novel metric-individual-level intraclass correlations-to assess data consistency at the cow-day level and evaluate its performance against 3 commonly used anomaly-detection methods. We further introduce a 2-step approach to estimate percentile thresholds for flagging outliers. The results demonstrate the superior performance of this new metric over the conventional univariate and multivariate methods in identifying anomalies in correlated partial daily milk component data. In addition, the negative impact of data shuffling was examined. Together, these methods provide robust and practical tools for detecting suspect milk component records at the individual cow-day level.
Authors
- John B. Cole (ORCID: https://orcid.org/0000-0003-1242-4401)
- João Dürr (ORCID: https://orcid.org/0000-0003-3834-6376)
- Asha M. Miles (ORCID: https://orcid.org/0000-0003-2175-7910)
- R.L. Baldwin (ORCID: https://orcid.org/0000-0002-0753-4377)
- Javier Burchard (ORCID: https://orcid.org/0000-0002-6412-7647)
- Malia J. Caputo (ORCID: https://orcid.org/0000-0002-5766-628X)
- Xiao‐Lin Wu (ORCID: https://orcid.org/0000-0002-5604-9220)
- Steven Sievert
- Jay Mattison
- Chip Donatone (ORCID: https://orcid.org/0009-0002-9239-8580)
Institutions
- Agricultural Research Service (US)
- University of Wisconsin–Madison (US)
- North Carolina State University (US)
- American Dairy Science Association (US)
- University of Florida (US)
- Dairy Management (US)
- Beltsville Agricultural Research Center (US)
- University of Guelph (CA)
Publication Details
- Journal
- JDS Communications
- Published
- 2025-12-13
- DOI
- https://doi.org/10.3168/jdsc.2025-0825
- Primary Topic
- Milk Quality and Mastitis in Dairy Cows
- Type
- article
- Field-Weighted Citation Impact
- 0.00