MTSClean: Efficient Constraint-Based Cleaning for Multi-Dimensional Time Series Data

The widespread existence of time series data in information systems poses significant challenges to data cleaning due to its quality issues, particularly the complex interdependencies among attributes and the persistence of errors. Existing semantic constraints, such as conditional regression rules and speed constraints, though helpful, remain insufficient for this task. This paper introduces two novel online cleaning methods: MTSClean and MTSClean- soft , designed to improve cleaning efficiency and robustness. By combining row and column constraints, we significantly accelerate the cleaning process, reducing the time complexity of the exact solution MTSClean from O (( NM ) 3.5 |Σ|) to O ( NM 3.5 |Σ|). Meanwhile, MTSClean- soft achieves O ( NM 2 ) and more precise repairs through optimized search for key cells and a novel repair cost function. Comparative experiments against nine benchmark methods highlight our approach's superiority in multiple metrics, completing cleaning tasks faster and performing better than state-of-the-art methods. This demonstrates the practicality and advantage of the proposed methods in cleaning multidimensional time series data.

Authors

Institutions

Publication Details

Journal
Proceedings of the VLDB Endowment
Published
2024-09-01
DOI
https://doi.org/10.14778/3704965.3704987
Citations
7
Primary Topic
Time Series Analysis and Forecasting
Type
article
Field-Weighted Citation Impact
2.45
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

MTSClean: Efficient Constraint-Based Cleaning for Multi-Dimensional Time Series Data

Donghua Yang, Xiaoou Ding, Yichen Song, Chen Wang et al.
7 citations
Proceedings of the VLDB Endowment
Time Series Analysis and Forecasting
2.45
article

MTSClean: Efficient Constraint-Based Cleaning for Multi-Dimensional Time Series Data

Donghua Yang, Xiaoou Ding, Yichen Song, Chen Wang, Hongzhi Wang
article en
7 citations

Abstract

The widespread existence of time series data in information systems poses significant challenges to data cleaning due to its quality issues, particularly the complex interdependencies among attributes and the persistence of errors. Existing semantic constraints, such as conditional regression rules and speed constraints, though helpful, remain insufficient for this task. This paper introduces two novel online cleaning methods: MTSClean and MTSClean- soft , designed to improve cleaning efficiency and robustness. By combining row and column constraints, we significantly accelerate the cleaning process, reducing the time complexity of the exact solution MTSClean from O (( NM ) 3.5 |Σ|) to O ( NM 3.5 |Σ|). Meanwhile, MTSClean- soft achieves O ( NM 2 ) and more precise repairs through optimized search for key cells and a novel repair cost function. Comparative experiments against nine benchmark methods highlight our approach's superiority in multiple metrics, completing cleaning tasks faster and performing better than state-of-the-art methods. This demonstrates the practicality and advantage of the proposed methods in cleaning multidimensional time series data.

Proceedings of the VLDB EndowmentVol. 17(13)
Harbin Institute of Technology (CN), Tsinghua University (CN)
Openalex Percentile: Top 9%
Time Series Analysis and Forecasting
2.45
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.