Leveraging multi-level correlations for imputing monitoring data in water supply systems using graph signal sampling theory

Data missing and anomalies in monitoring equipment have become critical barriers to developing intelligent Water Supply Systems (WSS). The valid data preceding and after the missing segments can be utilized to impute missing values. However, traditional imputation methods, such as linear interpolation and prediction-based methods, have limited capacity to use data relationships or can only utilize information before the missing values. Therefore, existing methods still need to work on efficiently and conveniently achieving high-accuracy imputation. According to the continuity and periodicity of WSS data, missing values often exhibit multi-level correlations with valid data. This paper innovatively employs graph structures to analyze the multi-level correlations at different timestamps and applies graph signal sampling algorithms to extract low-frequency features for imputation. A novel Graph-based Data Imputation (GDI) method has been developed, which leverages multi-level correlations to propagate information and completes imputation tasks without requiring complex feature engineering and pre-training processes. Results indicate that GDI outperforms Holt-Winters, Support Vector Regression, and Gated Recurrent Unit in the task of imputing continuous missing data. It can still achieve <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:msup><mml:mrow><mml:mi>R</mml:mi></mml:mrow> <mml:mn>2</mml:mn></mml:msup> <mml:mo>></mml:mo> <mml:mn>0.8</mml:mn></mml:mrow> </mml:math> even when the proportion of missing values reaches 80 %. These results demonstrate that GDI ensures a more streamlined and efficient imputation with high robustness and accuracy.

Authors

Institutions

Publication Details

Journal
Water Research X
Published
2024-11-08
DOI
https://doi.org/10.1016/j.wroa.2024.100274
Citations
3
Primary Topic
Network Security and Intrusion Detection
Type
article
Field-Weighted Citation Impact
1.05

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Leveraging multi-level correlations for imputing monitoring data in water supply systems using graph signal sampling theory

Rui Yuan, Xiao Hu Zhou, Wei Wang, Shuming Liu et al.
3 citations
Water Research X
Network Security and Intrusion Detection
1.05
article

Leveraging multi-level correlations for imputing monitoring data in water supply systems using graph signal sampling theory

Rui Yuan, Xiao Hu Zhou, Wei Wang, Shuming Liu, Juan Zhang, Yacan Man, Kuizu Su
article en
3 citations

Abstract

Data missing and anomalies in monitoring equipment have become critical barriers to developing intelligent Water Supply Systems (WSS). The valid data preceding and after the missing segments can be utilized to impute missing values. However, traditional imputation methods, such as linear interpolation and prediction-based methods, have limited capacity to use data relationships or can only utilize information before the missing values. Therefore, existing methods still need to work on efficiently and conveniently achieving high-accuracy imputation. According to the continuity and periodicity of WSS data, missing values often exhibit multi-level correlations with valid data. This paper innovatively employs graph structures to analyze the multi-level correlations at different timestamps and applies graph signal sampling algorithms to extract low-frequency features for imputation. A novel Graph-based Data Imputation (GDI) method has been developed, which leverages multi-level correlations to propagate information and completes imputation tasks without requiring complex feature engineering and pre-training processes. Results indicate that GDI outperforms Holt-Winters, Support Vector Regression, and Gated Recurrent Unit in the task of imputing continuous missing data. It can still achieve <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:msup><mml:mrow><mml:mi>R</mml:mi></mml:mrow> <mml:mn>2</mml:mn></mml:msup> <mml:mo>></mml:mo> <mml:mn>0.8</mml:mn></mml:mrow> </mml:math> even when the proportion of missing values reaches 80 %. These results demonstrate that GDI ensures a more streamlined and efficient imputation with high robustness and accuracy.

Water Research XVol. 25
Hefei University of Technology (CN), Tsinghua University (CN)
National Natural Science Foundation of China, Hefei University, Hefei University of Technology, Natural Science Foundation of Anhui Province, Fundamental Research Funds for the Central Universities
Clean water and sanitation
Openalex Percentile: Top 21%
Network Security and Intrusion Detection
1.05
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.