Long Time Series Forecasting Based on Dilated Causal Convolution and Focused Linear Attention with Informer

There are many time series data in our daily life and accurate prediction of these data can bring great convenience to our life. In this study, a hybrid prediction model based on dilated causal convolution, focused linear attention and Informer is proposed to improve the accuracy of predicting long time series. There are two main innovations in this paper:(1) Dilated causal convolution is added to the Informer model to extract the time series features and increase the sensory field of the model. (2) Focused linear attention is proposed to reduce the time complexity of predicting long sequences. The proposed model exhibits a 33.3% improvement in MSE metrics on the WTH dataset in comparison to Informer, an 89.4% improvement relative to Autofomer, a 18.9% improvement relative to Transformer, a 17.4% improvement relative to Pyraformer, and a 30.7% improvement relative to TimesNet. Consequently, the model is positioned as a frontrunner in the domain of time series prediction. In addition, the hybrid model demonstrates favorable outcomes on datasets pertaining to traffic, WTH, and other domains.

Authors

Institutions

Publication Details

Published
2024-10-11
DOI
https://doi.org/10.1109/cbase64041.2024.10824593
Primary Topic
Advanced Decision-Making Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Long Time Series Forecasting Based on Dilated Causal Convolution and Focused Linear Attention with Informer

Gonghao Duan, Rongjie Liu
Advanced Decision-Making Techniques
article

Long Time Series Forecasting Based on Dilated Causal Convolution and Focused Linear Attention with Informer

Gonghao Duan, Rongjie Liu
article en

Abstract

There are many time series data in our daily life and accurate prediction of these data can bring great convenience to our life. In this study, a hybrid prediction model based on dilated causal convolution, focused linear attention and Informer is proposed to improve the accuracy of predicting long time series. There are two main innovations in this paper:(1) Dilated causal convolution is added to the Informer model to extract the time series features and increase the sensory field of the model. (2) Focused linear attention is proposed to reduce the time complexity of predicting long sequences. The proposed model exhibits a 33.3% improvement in MSE metrics on the WTH dataset in comparison to Informer, an 89.4% improvement relative to Autofomer, a 18.9% improvement relative to Transformer, a 17.4% improvement relative to Pyraformer, and a 30.7% improvement relative to TimesNet. Consequently, the model is positioned as a frontrunner in the domain of time series prediction. In addition, the hybrid model demonstrates favorable outcomes on datasets pertaining to traffic, WTH, and other domains.

Wuhan Institute of Technology (CN)
Climate action
Openalex Percentile: Top 59%
Advanced Decision-Making Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.