Selective Enhanced Attention and Cross-Component Interaction for Long-Term Time Series Forecasting

Transformer-based methods have demonstrated promising performance in long-term time series forecasting. However, existing methods often consider interactions among all variables when modeling cross-variable correlations, which may introduce noise and redundant features from unrelated variables. These features distract the model's attention from relevant ones and increase the risk of overfitting. Moreover, the intertwined nature of long-term trends and short-term fluctuations in time series makes it challenging to model temporal dependencies effectively. To address these challenges, we propose the Selective Enhanced Time Series Transformer (SETST), which incorporates two key modules: the Selective Enhanced Attention (SEA) module and the Decomposition Component Fusion (DCF) module. SEA selectively captures correlations between highly related variables while filtering out meaningless information, facilitating cross-variable interaction learning. DCF integrates time series decomposition with cross-component interaction, enabling effective modeling of temporal dependencies. SETST demonstrates state-of-the-art performance on five real-world datasets.

Authors

Institutions

Publication Details

Journal
IEEE Signal Processing Letters
Published
2025-01-01
DOI
https://doi.org/10.1109/lsp.2025.3570679
Primary Topic
Time Series Analysis and Forecasting
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Selective Enhanced Attention and Cross-Component Interaction for Long-Term Time Series Forecasting

H. Li, Zhibin Yu, Hong Shun Hao, Siyv Ren
IEEE Signal Processing Letters
Time Series Analysis and Forecasting
article

Selective Enhanced Attention and Cross-Component Interaction for Long-Term Time Series Forecasting

H. Li, Zhibin Yu, Hong Shun Hao, Siyv Ren
article en

Abstract

Transformer-based methods have demonstrated promising performance in long-term time series forecasting. However, existing methods often consider interactions among all variables when modeling cross-variable correlations, which may introduce noise and redundant features from unrelated variables. These features distract the model's attention from relevant ones and increase the risk of overfitting. Moreover, the intertwined nature of long-term trends and short-term fluctuations in time series makes it challenging to model temporal dependencies effectively. To address these challenges, we propose the Selective Enhanced Time Series Transformer (SETST), which incorporates two key modules: the Selective Enhanced Attention (SEA) module and the Decomposition Component Fusion (DCF) module. SEA selectively captures correlations between highly related variables while filtering out meaningless information, facilitating cross-variable interaction learning. DCF integrates time series decomposition with cross-component interaction, enabling effective modeling of temporal dependencies. SETST demonstrates state-of-the-art performance on five real-world datasets.

IEEE Signal Processing LettersVol. 32
Ocean University of China (CN)
Climate action
Openalex Percentile: Top 88%
Time Series Analysis and Forecasting
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Selective Enhanced Attention and Cross-Component Interaction for Long-Term Time Series Forecasting — H. Li, Zhibin Yu, et al. · IEEE Signal Processing Letters (2025) | TGRS Research Map | TGRS