An Improved Adversarial Convolutional Transformer Model for Time Series Forecasting
Time series forecasting, as an important research topic in time series analysis, plays a crucial role in many fields. Traditional Transformer model often suffers from low feature dimension extraction and poor generalization ability when performing time series forecasting tasks. To address these issues, this paper proposes an Improved Adversarial Convolutional Transformer (IACT) model for time series forecasting. First, multi-dimensional features are extracted using the multi-head attention mechanism, and then more features are captured by multi-dimensional convolutional subspace in different dimensions to improve the representation capabilities of features. Meanwhile, an adversarial training strategy is used to make the model adapt to a larger range of data variations, which makes the model have a stronger generalization ability. Finally, experiment results conducted on two real time series datasets show that the model can obtain excellent prediction effects and generalization performance. In addition, the proposed model outperforms benchmark models such as Transformer, Pyraformer, and Informer in terms of prediction accuracy.
Authors
- Minglan Zhang
- Yisheng Zou (ORCID: https://orcid.org/0000-0003-0639-7064)
- Weiqi Cheng
- Linfu Sun (ORCID: https://orcid.org/0000-0002-3381-3548)
Institutions
- Southwest Jiaotong University (CN)
Publication Details
- Published
- 2024-09-27
- DOI
- https://doi.org/10.1109/ichci63580.2024.10808153
- Primary Topic
- Anomaly Detection Techniques and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00