An Improved Adversarial Convolutional Transformer Model for Time Series Forecasting

Time series forecasting, as an important research topic in time series analysis, plays a crucial role in many fields. Traditional Transformer model often suffers from low feature dimension extraction and poor generalization ability when performing time series forecasting tasks. To address these issues, this paper proposes an Improved Adversarial Convolutional Transformer (IACT) model for time series forecasting. First, multi-dimensional features are extracted using the multi-head attention mechanism, and then more features are captured by multi-dimensional convolutional subspace in different dimensions to improve the representation capabilities of features. Meanwhile, an adversarial training strategy is used to make the model adapt to a larger range of data variations, which makes the model have a stronger generalization ability. Finally, experiment results conducted on two real time series datasets show that the model can obtain excellent prediction effects and generalization performance. In addition, the proposed model outperforms benchmark models such as Transformer, Pyraformer, and Informer in terms of prediction accuracy.

Authors

Institutions

Publication Details

Published
2024-09-27
DOI
https://doi.org/10.1109/ichci63580.2024.10808153
Primary Topic
Anomaly Detection Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Improved Adversarial Convolutional Transformer Model for Time Series Forecasting

Minglan Zhang, Yisheng Zou, Weiqi Cheng, Linfu Sun
Anomaly Detection Techniques and Applications
article

An Improved Adversarial Convolutional Transformer Model for Time Series Forecasting

Minglan Zhang, Yisheng Zou, Weiqi Cheng, Linfu Sun
article en

Abstract

Time series forecasting, as an important research topic in time series analysis, plays a crucial role in many fields. Traditional Transformer model often suffers from low feature dimension extraction and poor generalization ability when performing time series forecasting tasks. To address these issues, this paper proposes an Improved Adversarial Convolutional Transformer (IACT) model for time series forecasting. First, multi-dimensional features are extracted using the multi-head attention mechanism, and then more features are captured by multi-dimensional convolutional subspace in different dimensions to improve the representation capabilities of features. Meanwhile, an adversarial training strategy is used to make the model adapt to a larger range of data variations, which makes the model have a stronger generalization ability. Finally, experiment results conducted on two real time series datasets show that the model can obtain excellent prediction effects and generalization performance. In addition, the proposed model outperforms benchmark models such as Transformer, Pyraformer, and Informer in terms of prediction accuracy.

Southwest Jiaotong University (CN)
Climate action
Openalex Percentile: Top 78%
Anomaly Detection Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

An Improved Adversarial Convolutional Transformer Model for Time Series Forecasting — Minglan Zhang, Yisheng Zou, et al. · (2024) | TGRS Research Map | TGRS