DSCformer: Non-Stationary Long-Time Prediction Methods Integrating Channel Spatial Attention

Time series fo recasting is crucial in many practical applications, and Transformer-based models have become cutting-edge tools for time series prediction. However, fo recasting tasks still face significant challenges when dealing with time series data characterized by noise and non-stationarity. This study proposes a new model based on the Autoformer architecture, called DSCformer, aiming to address long-term time series forecasting problems. Specifically, considering the simple linear mapping of the feed-forward module in the original model, we introduce a Channel-Space Attention Module (CSAM). This module allocates different attention to channels and spaces when extracting key information, enabling the model to suppress irrelevant noise information and accurately extract time series features. Additionally, in the self-attention mechanism, we introduce a De-stationary Attention module to extract non-stationary information. We applied this model to five real-world datasets, and experimental results indicate that compared to the original Autoformer, DSCformer reduces time series forecastin g errors by an average of 11.28%.

Authors

Institutions

Publication Details

Published
2024-09-20
DOI
https://doi.org/10.1109/itnec60942.2024.10733216
Primary Topic
Advanced Adaptive Filtering Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

DSCformer: Non-Stationary Long-Time Prediction Methods Integrating Channel Spatial Attention

Haokui Xu, Lei Zou, Wentao Wang
Advanced Adaptive Filtering Techniques
article

DSCformer: Non-Stationary Long-Time Prediction Methods Integrating Channel Spatial Attention

Haokui Xu, Lei Zou, Wentao Wang
article en

Abstract

Time series fo recasting is crucial in many practical applications, and Transformer-based models have become cutting-edge tools for time series prediction. However, fo recasting tasks still face significant challenges when dealing with time series data characterized by noise and non-stationarity. This study proposes a new model based on the Autoformer architecture, called DSCformer, aiming to address long-term time series forecasting problems. Specifically, considering the simple linear mapping of the feed-forward module in the original model, we introduce a Channel-Space Attention Module (CSAM). This module allocates different attention to channels and spaces when extracting key information, enabling the model to suppress irrelevant noise information and accurately extract time series features. Additionally, in the self-attention mechanism, we introduce a De-stationary Attention module to extract non-stationary information. We applied this model to five real-world datasets, and experimental results indicate that compared to the original Autoformer, DSCformer reduces time series forecastin g errors by an average of 11.28%.

Minzu University of China (CN)
Climate action
Openalex Percentile: Top 78%
Advanced Adaptive Filtering Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

DSCformer: Non-Stationary Long-Time Prediction Methods Integrating Channel Spatial Attention — Haokui Xu, Lei Zou, et al. · (2024) | TGRS Research Map | TGRS