Time-Series Representation Learning via Dual Reference Contrasting

The inherent complexity of real-world time series data, combined with the cost and infeasibility of manual labeling, presents considerable challenges to time series representation learning. Most existing studies tend to utilize data augmentation techniques to construct positive and negative samples and leverage a comparative learning framework to generate time series representations. However, they typically employ simple data augmentation techniques, such as jitter and cropping, to construct positive samples while randomly selecting irrelevant samples as negative ones, which are easily distinguished and unable to guide comparative learning to capture subtle discriminative features. Furthermore, they usually employ only a single positive sample for comparative learning, which is insufficient to model the diversity and hurts the robustness. To address these issues, this paper proposes a Time Series representation learning framework via Dual Reference Contrasting (TS-DRC). Specifically, we first utilize Markov transition field or Gramian angular field to transform the anchor sample of time series into image representations, which are adopted as positive samples. Then, we incorporate two positive samples (dual references) and one negative sample into the comparative learning framework, and devise a novel optimization objective to guide the model to capture more discriminate features, mitigate overfitting, and enhance the robustness. Extensive experiments conducted on four public real-world datasets demonstrate that our TS-DRC outperforms other state-of-the-art baselines.Our code is available at: https://github.com/yurui12138/TS-DRC.

Authors

Institutions

Publication Details

Published
2024-10-20
DOI
https://doi.org/10.1145/3627673.3679699
Citations
1
Primary Topic
Time Series Analysis and Forecasting
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Time-Series Representation Learning via Dual Reference Contrasting

Yongshun Gong, Xueping Peng, Wenpeng Lü, Shoujin Wang et al.
1 citations
Time Series Analysis and Forecasting
0.35
article

Time-Series Representation Learning via Dual Reference Contrasting

Yongshun Gong, Xueping Peng, Wenpeng Lü, Shoujin Wang, Bing Xu, Jiasheng Si, Rui Yu
article en
1 citations

Abstract

The inherent complexity of real-world time series data, combined with the cost and infeasibility of manual labeling, presents considerable challenges to time series representation learning. Most existing studies tend to utilize data augmentation techniques to construct positive and negative samples and leverage a comparative learning framework to generate time series representations. However, they typically employ simple data augmentation techniques, such as jitter and cropping, to construct positive samples while randomly selecting irrelevant samples as negative ones, which are easily distinguished and unable to guide comparative learning to capture subtle discriminative features. Furthermore, they usually employ only a single positive sample for comparative learning, which is insufficient to model the diversity and hurts the robustness. To address these issues, this paper proposes a Time Series representation learning framework via Dual Reference Contrasting (TS-DRC). Specifically, we first utilize Markov transition field or Gramian angular field to transform the anchor sample of time series into image representations, which are adopted as positive samples. Then, we incorporate two positive samples (dual references) and one negative sample into the comparative learning framework, and devise a novel optimization objective to guide the model to capture more discriminate features, mitigate overfitting, and enhance the robustness. Extensive experiments conducted on four public real-world datasets demonstrate that our TS-DRC outperforms other state-of-the-art baselines.Our code is available at: https://github.com/yurui12138/TS-DRC.

University of Technology Sydney (AU), Qilu University of Technology (CN), Shandong University (CN), Harbin Institute of Technology (CN), Shandong Academy of Sciences (CN)
Openalex Percentile: Top 43%
Time Series Analysis and Forecasting
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.