Simultaneous Data Reconciliation and Gross Error Detection Based on Denoising Autoencoder

Industrial process data is usually affected by random and gross errors leading to deviation from the true value and violation of process constraints. Traditional data reconciliation methods rely on accurate process model, which can lead to incorrect reconciliation results if the model is not accurate enough. This paper proposes a deep learning approach based on denoising autoencoder (DAE) for dealing with simultaneous data reconciliation and gross error detection(SDR & GED) in steady state systems without directly using the process models/constraints. Reconciled values that satisfy the process constraints can be gradually obtained by iterative training. In addition, a pre-training method is proposed to accelerate the training procedure. The proposed DAE framework is equipped with a one dimensional convolutional neural network, which can reduce the model complexity. Furthermore, DAE is capable of handling a variety of noises, so that data with different types of noise distributions can still be reconciled effectively. Finally, loop analysis and process constraints construction for the hot section of an olefin plant are performed, and the effectiveness of the proposed method is verified by the study of this system.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Instrumentation and Measurement
Published
2025-01-01
DOI
https://doi.org/10.1109/tim.2025.3574904
Primary Topic
Anomaly Detection Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Simultaneous Data Reconciliation and Gross Error Detection Based on Denoising Autoencoder

Biao Luo, Xiaodong Xu, Zhisheng Chen, Yuan Yuan et al.
3 links
IEEE Transactions on Instrumentation and Measurement
Anomaly Detection Techniques and Applications
article

Simultaneous Data Reconciliation and Gross Error Detection Based on Denoising Autoencoder

Biao Luo, Xiaodong Xu, Zhisheng Chen, Yuan Yuan, Hong Yan Yang
article en

Abstract

Industrial process data is usually affected by random and gross errors leading to deviation from the true value and violation of process constraints. Traditional data reconciliation methods rely on accurate process model, which can lead to incorrect reconciliation results if the model is not accurate enough. This paper proposes a deep learning approach based on denoising autoencoder (DAE) for dealing with simultaneous data reconciliation and gross error detection(SDR & GED) in steady state systems without directly using the process models/constraints. Reconciled values that satisfy the process constraints can be gradually obtained by iterative training. In addition, a pre-training method is proposed to accelerate the training procedure. The proposed DAE framework is equipped with a one dimensional convolutional neural network, which can reduce the model complexity. Furthermore, DAE is capable of handling a variety of noises, so that data with different types of noise distributions can still be reconciled effectively. Finally, loop analysis and process constraints construction for the hot section of an olefin plant are performed, and the effectiveness of the proposed method is verified by the study of this system.

IEEE Transactions on Instrumentation and MeasurementVol. 74
Central South University (CN), University of Alberta (CA), Changsha University of Science and Technology (CN)
National Natural Science Foundation of China, Natural Science Foundation of Hunan Province
Reduced inequalities
Openalex Percentile: Top 94%
Anomaly Detection Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Simultaneous Data Reconciliation and Gross Error Detection Based on Denoising Autoencoder — Biao Luo, Xiaodong Xu, et al. · IEEE Transactions on Instrumentation and Measurement (2025) | TGRS Research Map | TGRS