Efficient Feature Drift Detection in Multidimensional Time Series Using PCA

This paper introduces an efficient method for detecting feature drift in multidimensional time series using Principal Component Analysis (PCA). Traditional approaches rely on applying univariate drift detectors to each feature individually, which is both resource-intensive and time-consuming due to the high dimensionality of data. To address this challenge, we focus on reducing the data to a lower-dimensional space using PCA, which captures the most significant variance while decreasing computational complexity. In our method, we apply drift detectors (ADWIN, KSWIN, and Page-Hinkley) to the principal components derived from PCA. A drift is detected if any two detectors signal a drift within a specified time window. The ensemble decision strategy consolidates these detections to identify baseline drift points accurately. We then use a factor loading model to map detected drifts back to the original features, quantifying the drift strength for each feature over time and reducing false positives by introducing a threshold on drift strength values. Our approach was validated on multiple datasets, demonstrating that PCA-based dimensionality reduction maintains high drift detection accuracy while significantly reducing computational costs. The results highlight the trade-offs between detection performance and computational efficiency, showcasing the practical benefits of our proposed method.

Authors

Institutions

Publication Details

Published
2024-10-25
DOI
https://doi.org/10.1109/icaise65384.2024.00010
Citations
1
Primary Topic
Time Series Analysis and Forecasting
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Efficient Feature Drift Detection in Multidimensional Time Series Using PCA

Marcell Németh, G. Benedek, Gábor Szücs
1 citations
Time Series Analysis and Forecasting
0.35
article

Efficient Feature Drift Detection in Multidimensional Time Series Using PCA

Marcell Németh, G. Benedek, Gábor Szücs
article en
1 citations

Abstract

This paper introduces an efficient method for detecting feature drift in multidimensional time series using Principal Component Analysis (PCA). Traditional approaches rely on applying univariate drift detectors to each feature individually, which is both resource-intensive and time-consuming due to the high dimensionality of data. To address this challenge, we focus on reducing the data to a lower-dimensional space using PCA, which captures the most significant variance while decreasing computational complexity. In our method, we apply drift detectors (ADWIN, KSWIN, and Page-Hinkley) to the principal components derived from PCA. A drift is detected if any two detectors signal a drift within a specified time window. The ensemble decision strategy consolidates these detections to identify baseline drift points accurately. We then use a factor loading model to map detected drifts back to the original features, quantifying the drift strength for each feature over time and reducing false positives by introducing a threshold on drift strength values. Our approach was validated on multiple datasets, demonstrating that PCA-based dimensionality reduction maintains high drift detection accuracy while significantly reducing computational costs. The results highlight the trade-offs between detection performance and computational efficiency, showcasing the practical benefits of our proposed method.

Budapest University of Technology and Economics (HU)
Affordable and clean energy
Openalex Percentile: Top 38%
Time Series Analysis and Forecasting
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Efficient Feature Drift Detection in Multidimensional Time Series Using PCA — Marcell Németh, G. Benedek, et al. · (2024) | TGRS Research Map | TGRS