Unsupervised Anomaly Detection in Spatio‐Temporal Stream Network Sensor Data

Abstract The use of in‐situ digital sensors for water quality monitoring is becoming increasingly common worldwide. While these sensors provide near real‐time data for science, the data are prone to technical anomalies that can undermine the trustworthiness of the data and the accuracy of statistical inferences, particularly in spatial and temporal analyses. Here we propose a framework for detecting anomalies in sensor data recorded in stream networks, which takes advantage of spatial and temporal autocorrelation to improve detection rates. The proposed framework involves the implementation of effective data imputation to handle missing data, alignment of time‐series to address temporal disparities, and the identification of water quality events. We explore the effectiveness of a suite of state‐of‐the‐art statistical methods including posterior predictive distributions, finite mixtures, and Hidden Markov Models (HMM). We showcase the practical implementation of automated anomaly detection in near‐real time by employing a Bayesian recursive approach. This demonstration is conducted through a comprehensive simulation study and a practical application to a substantive case study situated in the Herbert River, located in Queensland, Australia, which flows into the Great Barrier Reef. We found that methods such as posterior predictive distributions and HMM produce the best performance in detecting multiple types of anomalies. Utilizing data from multiple sensors deployed relatively near one another enhances the ability to distinguish between water quality events and technical anomalies, thereby significantly improving the accuracy of anomaly detection. Thus, uncertainty and biases in water quality reporting, interpretation, and modeling are reduced, and the effectiveness of subsequent management actions improved.

Authors

Institutions

Publication Details

Journal
Water Resources Research
Published
2024-11-01
DOI
https://doi.org/10.1029/2023wr035707
Citations
10
Primary Topic
Anomaly Detection Techniques and Applications
Type
article
Field-Weighted Citation Impact
3.13

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Unsupervised Anomaly Detection in Spatio‐Temporal Stream Network Sensor Data

Erin E. Peterson, Kerrie Lee Mengersen, Cesar A. Villa, Ryan Turner et al.
10 citations
Water Resources Research
Anomaly Detection Techniques and Applications
3.13
article

Unsupervised Anomaly Detection in Spatio‐Temporal Stream Network Sensor Data

Erin E. Peterson, Kerrie Lee Mengersen, Cesar A. Villa, Ryan Turner, Edgar Santos–Fernández, Jay M. Ver Hoef, James M. McGree, Catherine Leigh, Cameron Roberts
article en
10 citations

Abstract

Abstract The use of in‐situ digital sensors for water quality monitoring is becoming increasingly common worldwide. While these sensors provide near real‐time data for science, the data are prone to technical anomalies that can undermine the trustworthiness of the data and the accuracy of statistical inferences, particularly in spatial and temporal analyses. Here we propose a framework for detecting anomalies in sensor data recorded in stream networks, which takes advantage of spatial and temporal autocorrelation to improve detection rates. The proposed framework involves the implementation of effective data imputation to handle missing data, alignment of time‐series to address temporal disparities, and the identification of water quality events. We explore the effectiveness of a suite of state‐of‐the‐art statistical methods including posterior predictive distributions, finite mixtures, and Hidden Markov Models (HMM). We showcase the practical implementation of automated anomaly detection in near‐real time by employing a Bayesian recursive approach. This demonstration is conducted through a comprehensive simulation study and a practical application to a substantive case study situated in the Herbert River, located in Queensland, Australia, which flows into the Great Barrier Reef. We found that methods such as posterior predictive distributions and HMM produce the best performance in detecting multiple types of anomalies. Utilizing data from multiple sensors deployed relatively near one another enhances the ability to distinguish between water quality events and technical anomalies, thereby significantly improving the accuracy of anomaly detection. Thus, uncertainty and biases in water quality reporting, interpretation, and modeling are reduced, and the effectiveness of subsequent management actions improved.

Water Resources ResearchVol. 60(11)
Queensland University of Technology (AU), The University of Queensland (AU), NOAA National Marine Fisheries Service Alaska Fisheries Science Center (US), Queensland Department of Environment and Science (AU), Environmental Earth Sciences (AU), RMIT University (AU)
Australian Research Council
Openalex Percentile: Top 7%
Anomaly Detection Techniques and Applications
3.13
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.