Simulation-based comparison of unsupervised anomaly detection and conventional multi-rules for clinical biochemistry quality control

Background Internal quality control is commonly carried out using rule-based systems such as Westgard multirules and the exponentially weighted moving average. However, these methods may be slow to detect gradual drift and imprecision changes in current analyzers. Unsupervised anomaly detection algorithms, trained on in-control quality control data, provide an additional data-driven approach that does not require patient data. Methods We generate synthetic IQC data with four faults: a +2 SD step shift, a linear trend to +2 SD, an abrupt doubling of the SD, and intermittent ±4 SD outliers (3% of post-onset runs) on a standardized z-scale, including 54,000 QC-level series (12 analyte labels × 3 QC levels × 5 scenarios × 300 replications). We used Holm-corrected paired tests and bootstrap confidence intervals to summarise delay per replication (median across 12 analytes); outlier delay was calculated from the first injected outlier, and delay in fault-free streams served as the no-fault reference. A severity sweep changed the fault’s trajectory and size. Results Step shifts had median delays of 0.0–2.0 runs, while sudden imprecision increases had median delays of 0.5–3.5 runs, with CUSUM being the slowest. Delays from the initial injected outlier were 1.0 for EWMA, 12.5 for CUSUM, and 0.0 runs for Westgard, Isolation Forest, and One-Class SVM. The median delays for the trend were 19.8 (EWMA), 23.5 (Isolation Forest), 30.0 (Westgard), 31.5 (One-Class SVM), and 44.0 runs (CUSUM). Except for CUSUM, the trend delays were only roughly 2–7 runs shorter than the time to first alert in fault-free streams, and the false-alarm rates (2.2–5.2 per 100 analyte-runs) did not match. Most of the machine-learning discrimination was explained by engineered temporal features (imprecision AUC for Isolation Forest 0.93 with all features versus 0.70 with z and |z| only). Conclusion No method was consistently the fastest; instead, performance varied by defect type and false-alarm operating point. Discrepancies in the false-alarm rate were a major factor in explaining apparent discrepancies between techniques for slowly developing trends. Validation using actual laboratory QC data is necessary because these standardized simulations do not show clinical benefit.

Authors

Institutions

Publication Details

Journal
British Journal of Biomedical Science
Published
2026-11-17
DOI
https://doi.org/10.3389/bjbs.2026.17568
Primary Topic
Clinical Laboratory Practices and Quality Control
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Simulation-based comparison of unsupervised anomaly detection and conventional multi-rules for clinical biochemistry quality control

Afreenish Amir, Mariam Ammoun, Muhammad Muneeb Tariq, Muhammad Haseeb Tariq et al.
1 links
British Journal of Biomedical Science
Clinical Laboratory Practices and Quality Control
article

Simulation-based comparison of unsupervised anomaly detection and conventional multi-rules for clinical biochemistry quality control

Afreenish Amir, Mariam Ammoun, Muhammad Muneeb Tariq, Muhammad Haseeb Tariq, Claire Price, Melissa Harrison, Ahmed Laher
article en

Abstract

Background Internal quality control is commonly carried out using rule-based systems such as Westgard multirules and the exponentially weighted moving average. However, these methods may be slow to detect gradual drift and imprecision changes in current analyzers. Unsupervised anomaly detection algorithms, trained on in-control quality control data, provide an additional data-driven approach that does not require patient data. Methods We generate synthetic IQC data with four faults: a +2 SD step shift, a linear trend to +2 SD, an abrupt doubling of the SD, and intermittent ±4 SD outliers (3% of post-onset runs) on a standardized z-scale, including 54,000 QC-level series (12 analyte labels × 3 QC levels × 5 scenarios × 300 replications). We used Holm-corrected paired tests and bootstrap confidence intervals to summarise delay per replication (median across 12 analytes); outlier delay was calculated from the first injected outlier, and delay in fault-free streams served as the no-fault reference. A severity sweep changed the fault’s trajectory and size. Results Step shifts had median delays of 0.0–2.0 runs, while sudden imprecision increases had median delays of 0.5–3.5 runs, with CUSUM being the slowest. Delays from the initial injected outlier were 1.0 for EWMA, 12.5 for CUSUM, and 0.0 runs for Westgard, Isolation Forest, and One-Class SVM. The median delays for the trend were 19.8 (EWMA), 23.5 (Isolation Forest), 30.0 (Westgard), 31.5 (One-Class SVM), and 44.0 runs (CUSUM). Except for CUSUM, the trend delays were only roughly 2–7 runs shorter than the time to first alert in fault-free streams, and the false-alarm rates (2.2–5.2 per 100 analyte-runs) did not match. Most of the machine-learning discrimination was explained by engineered temporal features (imprecision AUC for Isolation Forest 0.93 with all features versus 0.70 with z and |z| only). Conclusion No method was consistently the fastest; instead, performance varied by defect type and false-alarm operating point. Discrepancies in the false-alarm rate were a major factor in explaining apparent discrepancies between techniques for slowly developing trends. Validation using actual laboratory QC data is necessary because these standardized simulations do not show clinical benefit.

British Journal of Biomedical ScienceVol. 83
Quaid-i-Azam University (PK), Royal Marsden NHS Foundation Trust (GB), Swansea University (GB), Royal Marsden Hospital (GB), Mid Yorkshire Hospitals NHS Trust (GB), National Institute of Health (PK)
Good health and well-being
Clinical Laboratory Practices and Quality Control
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon