ACD: A Lossless Compression Based on Dimensionality Reduction for Multi-dimensional Time Series Data

Multi-dimensional time series data are generated daily in lots of domains. Compressing these data to reduce storage overhead is an important topic. Existing compression algorithms resort to converting multi-dimensional time series data into multiple separate one-dimensional data to compress. However, these algorithms fail to exploit both intra- and inter-correlation among dimensions and the compression is not efficient. To solve the problem, this paper introduces a novel multi-dimensional time series compression framework called ACD, a lossless compression based on dimensionality reduction. Initially, the n-dimensional time series data undergo dimensionality reduction via space-filling curves(SFCs) encoding. Subsequently, we partition the encoded data heuristically into several segments based on distinctive patterns in different time windows. Finally, suitable compression is conducted according to segment patterns. We implement our algorithm in an out-of-box commercial time series database engine VictoriaMetrics. Our experiments demonstrate that ACD achieves at least 40% improvement over existing methods such as Chimp, Gorilla, and DeltaZstd as evaluated through the Time Series Benchmark Suite(TSBS).

Authors

Institutions

Publication Details

Published
2024-12-13
DOI
https://doi.org/10.1109/icftic64248.2024.10913266
Primary Topic
Time Series Analysis and Forecasting
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ACD: A Lossless Compression Based on Dimensionality Reduction for Multi-dimensional Time Series Data

Liang Liu, Haolong Chen
Time Series Analysis and Forecasting
article

ACD: A Lossless Compression Based on Dimensionality Reduction for Multi-dimensional Time Series Data

Liang Liu, Haolong Chen
article en

Abstract

Multi-dimensional time series data are generated daily in lots of domains. Compressing these data to reduce storage overhead is an important topic. Existing compression algorithms resort to converting multi-dimensional time series data into multiple separate one-dimensional data to compress. However, these algorithms fail to exploit both intra- and inter-correlation among dimensions and the compression is not efficient. To solve the problem, this paper introduces a novel multi-dimensional time series compression framework called ACD, a lossless compression based on dimensionality reduction. Initially, the n-dimensional time series data undergo dimensionality reduction via space-filling curves(SFCs) encoding. Subsequently, we partition the encoded data heuristically into several segments based on distinctive patterns in different time windows. Finally, suitable compression is conducted according to segment patterns. We implement our algorithm in an out-of-box commercial time series database engine VictoriaMetrics. Our experiments demonstrate that ACD achieves at least 40% improvement over existing methods such as Chimp, Gorilla, and DeltaZstd as evaluated through the Time Series Benchmark Suite(TSBS).

Nanjing University of Aeronautics and Astronautics (CN)
Affordable and clean energy
Openalex Percentile: Top 69%
Time Series Analysis and Forecasting
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

ACD: A Lossless Compression Based on Dimensionality Reduction for Multi-dimensional Time Series Data — Liang Liu, Haolong Chen · (2024) | TGRS Research Map | TGRS