Exploring time series analysis in frequency domain with complex-valued spectral attention and bidirectional variable mamba

Recently, deep learning has made significant strides in multivariate time series forecasting. While frequency-domain-based methods have shown promising results, existing models often struggle with frequency misalignment when handling diverse frequency combinations, leading to reduced forecasting accuracy. To address these issues, we propose the Spectral Attention Module (SAM), which integrates temporal and frequency-domain information to effectively capture both local and global dependencies in time series data. Within the frequency-domain module, we introduce an Extended Discrete Fourier Transform to overcome frequency misalignment challenges and design a Complex-Valued Spectral Attention Mechanism (CV-SAM) to identify and exploit complex relationships among different frequency combinations. To further capture inter-variable correlations, we propose the Bidirectional Variable Mamba. It uses linear layers to encode timestamps for each variable and employs the Mamba layer to extract inter-variable correlations, supported by a feedforward network to learn temporal dependencies. By combining the SAM and the BV-Mamba, we construct the SpectroMamba, which demonstrates superior performance over state-of-the-art methods in long-term time series forecasting across multiple real-world datasets.

Authors

Institutions

Publication Details

Journal
The Journal of Supercomputing
Published
2025-05-23
DOI
https://doi.org/10.1007/s11227-025-07277-9
Citations
10
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
24.81
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Exploring time series analysis in frequency domain with complex-valued spectral attention and bidirectional variable mamba

Qinghe Zhao, X. H. Mo, F. S. Lai
10 citations
The Journal of Supercomputing
Neural Networks and Applications
24.81
article

Exploring time series analysis in frequency domain with complex-valued spectral attention and bidirectional variable mamba

Qinghe Zhao, X. H. Mo, F. S. Lai
article en
10 citations

Abstract

Recently, deep learning has made significant strides in multivariate time series forecasting. While frequency-domain-based methods have shown promising results, existing models often struggle with frequency misalignment when handling diverse frequency combinations, leading to reduced forecasting accuracy. To address these issues, we propose the Spectral Attention Module (SAM), which integrates temporal and frequency-domain information to effectively capture both local and global dependencies in time series data. Within the frequency-domain module, we introduce an Extended Discrete Fourier Transform to overcome frequency misalignment challenges and design a Complex-Valued Spectral Attention Mechanism (CV-SAM) to identify and exploit complex relationships among different frequency combinations. To further capture inter-variable correlations, we propose the Bidirectional Variable Mamba. It uses linear layers to encode timestamps for each variable and employs the Mamba layer to extract inter-variable correlations, supported by a feedforward network to learn temporal dependencies. By combining the SAM and the BV-Mamba, we construct the SpectroMamba, which demonstrates superior performance over state-of-the-art methods in long-term time series forecasting across multiple real-world datasets.

The Journal of SupercomputingVol. 81(8)
University of Denver (US), University of Exeter (GB), New York University (US)
Openalex Percentile: Top 1%
Neural Networks and Applications
24.81
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Exploring time series analysis in frequency domain with complex-valued spectral attention and bidirectional variable mamba — Qinghe Zhao, X. H. Mo, et al. · The Journal of Supercomputing (2025) | TGRS Research Map | TGRS