Valid but Uninformative: AI Process Alarms Beyond the Commissioned Operating Range

We ask whether an artificial intelligence (AI)-enabled process monitor’s alarms remain informative beyond its commissioned operating range. Conformal alarm rules rely on exchangeability, which deployment shifts can break. Conditioning calibration on the operating point restores validity, not necessarily informativeness: the certificate constrains only the fault-free calibration law, so a diagnostic relying only on that law cannot identify the loss without an additional assumption. Across ten one-class detectors in a seed-controlled Tennessee Eastman campaign with counterfactual twins, validity holds at every evaluated level while informativeness decays. Resolved at ×0.001, the loss is a ramp, not a step, crossing a declared 0.70 floor at ×0.825. There the plant is bistable: fault-free episodes settle into a steady mode or an unsteady one with the purge valve on its stop, the detectors cannot rank the fault inside the unsteady mode, and informativeness above chance scales with the square of the steady share. Disabling that protective override removes the unsteady mode and lifts far-edge receiver operating characteristic (ROC) area from 0.47 to 0.76. Supervised classifiers recover the ranking only when trained on labelled faults in that settled state. Fault-free commissioning measurements, mapped by a curve fitted on labelled faults, predict the loss to a mean absolute ROC-area error of 0.041.

Authors

Institutions

Publication Details

Journal
Processes
Published
2026-10-30
DOI
https://doi.org/10.3390/pr14213483
Primary Topic
Fault Detection and Control Systems
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Valid but Uninformative: AI Process Alarms Beyond the Commissioned Operating Range

Young Im Cho, Norkobil Saydirasulov Saydirasulovic
Processes
Fault Detection and Control Systems
article

Valid but Uninformative: AI Process Alarms Beyond the Commissioned Operating Range

Young Im Cho, Norkobil Saydirasulov Saydirasulovic
article en

Abstract

We ask whether an artificial intelligence (AI)-enabled process monitor’s alarms remain informative beyond its commissioned operating range. Conformal alarm rules rely on exchangeability, which deployment shifts can break. Conditioning calibration on the operating point restores validity, not necessarily informativeness: the certificate constrains only the fault-free calibration law, so a diagnostic relying only on that law cannot identify the loss without an additional assumption. Across ten one-class detectors in a seed-controlled Tennessee Eastman campaign with counterfactual twins, validity holds at every evaluated level while informativeness decays. Resolved at ×0.001, the loss is a ramp, not a step, crossing a declared 0.70 floor at ×0.825. There the plant is bistable: fault-free episodes settle into a steady mode or an unsteady one with the purge valve on its stop, the detectors cannot rank the fault inside the unsteady mode, and informativeness above chance scales with the square of the steady share. Disabling that protective override removes the unsteady mode and lifts far-edge receiver operating characteristic (ROC) area from 0.47 to 0.76. Supervised classifiers recover the ranking only when trained on labelled faults in that settled state. Fault-free commissioning measurements, mapped by a curve fitted on labelled faults, predict the loss to a mean absolute ROC-area error of 0.041.

ProcessesVol. 14(21)
Gachon University (KR), Samarkand State University named after Sharof Rashidov (UZ), ZARMED University (UZ)
Korea Evaluation Institute of Industrial Technology
Openalex Percentile: Top 18%
Fault Detection and Control Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon