<scp>SDKT</scp>: Similar Domain Knowledge Transfer for Multivariate Time Series Classification Tasks

ABSTRACT Multivariate time series data classification has a wide range of applications in reality. With rapid development of deep learning, convolutional networks are widely used in this task and have achieved the current best performance. However, due to high difficulty and cost of collecting this type of data, labeled data is still scarce. In some tasks, the model shows overfitting, resulting in relatively poor classification performance. In order to improve the classification performance under such situation, we proposed a novel classification method based on transfer learning—similar domain knowledge transfer (call SDKT for short). Firstly, we designed a multivariate time series domain distance calculation method (call MTSDDC for short), which helped selecting the source domain that is most similar to target domain; Secondly, we used ResNet as a pre‐trained classifier, transferred the parameters of the similar domain network to the target domain network and continue to fine‐tune the parameters. To verify our method, we conducted experiments on several public datasets. Our study has also shown that the transfer effect from the source domain to the target domain is highly negatively correlated with the distance between them, with an average Pearson coefficient of −0.78. For the transfer of most similar source domain, compared to the ResNet model without transfer and the current best model, the average accuracy improvements on the datasets we used are 4.01% and 1.46% respectively.

Authors

Institutions

Publication Details

Journal
Computational Intelligence
Published
2024-11-19
DOI
https://doi.org/10.1111/coin.70008
Primary Topic
Time Series Analysis and Forecasting
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

SDKT: Similar Domain Knowledge Transfer for Multivariate Time Series Classification Tasks

Jiaye Wen, Wenan Zhou
Computational Intelligence
Time Series Analysis and Forecasting
article

SDKT: Similar Domain Knowledge Transfer for Multivariate Time Series Classification Tasks

Jiaye Wen, Wenan Zhou
article en

Abstract

ABSTRACT Multivariate time series data classification has a wide range of applications in reality. With rapid development of deep learning, convolutional networks are widely used in this task and have achieved the current best performance. However, due to high difficulty and cost of collecting this type of data, labeled data is still scarce. In some tasks, the model shows overfitting, resulting in relatively poor classification performance. In order to improve the classification performance under such situation, we proposed a novel classification method based on transfer learning—similar domain knowledge transfer (call SDKT for short). Firstly, we designed a multivariate time series domain distance calculation method (call MTSDDC for short), which helped selecting the source domain that is most similar to target domain; Secondly, we used ResNet as a pre‐trained classifier, transferred the parameters of the similar domain network to the target domain network and continue to fine‐tune the parameters. To verify our method, we conducted experiments on several public datasets. Our study has also shown that the transfer effect from the source domain to the target domain is highly negatively correlated with the distance between them, with an average Pearson coefficient of −0.78. For the transfer of most similar source domain, compared to the ResNet model without transfer and the current best model, the average accuracy improvements on the datasets we used are 4.01% and 1.46% respectively.

Computational IntelligenceVol. 40(6)
Beijing University of Posts and Telecommunications (CN)
Openalex Percentile: Top 77%
Time Series Analysis and Forecasting
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

<scp>SDKT</scp>: Similar Domain Knowledge Transfer for Multivariate Time Series Classification Tasks — Jiaye Wen, Wenan Zhou · Computational Intelligence (2024) | TGRS Research Map | TGRS