General adapted‐threshold monitoring in discrete environments and rules for imbalanced classes

Having in mind applications in statistics and machine learning such as individualized care monitoring, or watermark detection in large language models, we consider the following general setting: When monitoring a sequence of observations, , there may be additional information, , on the environment which should be used to design the monitoring procedure. This additional information can be incorporated by applying threshold functions to the standardized measurements to adapt the detector to the environment. For the case of categorical data encoding of discrete‐valued environmental information we study several classes of level threshold functions including a proportional one which favors rare events among imbalanced classes. For the latter rule asymptotic theory is developed for independent and identically distributed and dependent learning samples including data from new discrete autoregressive moving average model (NDARMA) series and Hidden Markov Models. Further, we propose two‐stage designs which allow to distribute in a controlled way the budget over an a priori partition of the sample space of . The approach is illustrated by a real medical data set.

Authors

Institutions

Publication Details

Journal
Statistica Neerlandica
Published
2024-08-21
DOI
https://doi.org/10.1111/stan.12352
Citations
1
Primary Topic
Advanced Statistical Process Monitoring
Type
article
Field-Weighted Citation Impact
0.46
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

General adapted‐threshold monitoring in discrete environments and rules for imbalanced classes

Ansgar Steland, Ewaryst Rafajłowicz, Wojciech Rafajłowicz
1 citations
Statistica Neerlandica
Advanced Statistical Process Monitoring
0.46
article

General adapted‐threshold monitoring in discrete environments and rules for imbalanced classes

Ansgar Steland, Ewaryst Rafajłowicz, Wojciech Rafajłowicz
article en
1 citations

Abstract

Having in mind applications in statistics and machine learning such as individualized care monitoring, or watermark detection in large language models, we consider the following general setting: When monitoring a sequence of observations, , there may be additional information, , on the environment which should be used to design the monitoring procedure. This additional information can be incorporated by applying threshold functions to the standardized measurements to adapt the detector to the environment. For the case of categorical data encoding of discrete‐valued environmental information we study several classes of level threshold functions including a proportional one which favors rare events among imbalanced classes. For the latter rule asymptotic theory is developed for independent and identically distributed and dependent learning samples including data from new discrete autoregressive moving average model (NDARMA) series and Hidden Markov Models. Further, we propose two‐stage designs which allow to distribute in a controlled way the budget over an a priori partition of the sample space of . The approach is illustrated by a real medical data set.

Statistica NeerlandicaVol. 79(1)
Wrocław University of Science and Technology (PL), RWTH Aachen University (DE)
Openalex Percentile: Top 29%
Advanced Statistical Process Monitoring
0.46
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.