TSLANet: Rethinking Transformers for Time Series Representation Learning

Time series data inherently contains both short- and long-range dependencies, posing persistent challenges for analysis across diverse applications. Although Transformer-based approaches are effective at modeling long-term dependencies, they often suffer from high computational cost, sensitivity to noise, and overfitting on small datasets. To address these issues, we propose TSLANet, a lightweight and universal convolutional framework for time series analysis. The model incorporates an Adaptive Spectral Block that leverages Fourier analysis to represent features in both temporal and frequency domains, enabling effective modeling of local and global dependencies while suppressing noise through adaptive thresholding. Furthermore, an Interactive Convolution Block is introduced, and self-supervised learning strategies are employed to enhance temporal representation learning and improve robustness across datasets. Extensive experiments demonstrate that TSLANet achieves state-of-the-art performance in forecasting, classification, and anomaly detection tasks, exhibiting strong adaptability and stability across varying noise intensities and data scales.

Authors

Publication Details

Published
2026-05-18
DOI
https://doi.org/10.1201/9781003616719-3
Citations
22
Primary Topic
Time Series Analysis and Forecasting
Type
preprint
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

TSLANet: Rethinking Transformers for Time Series Representation Learning

Emadeldeen Eldele, Mohamed Ragab, Zhenghua Chen, Min Wu et al.
22 citations
Time Series Analysis and Forecasting
preprint

TSLANet: Rethinking Transformers for Time Series Representation Learning

Emadeldeen Eldele, Mohamed Ragab, Zhenghua Chen, Min Wu, Xiaoli Li
preprint en
22 citations

Abstract

Time series data inherently contains both short- and long-range dependencies, posing persistent challenges for analysis across diverse applications. Although Transformer-based approaches are effective at modeling long-term dependencies, they often suffer from high computational cost, sensitivity to noise, and overfitting on small datasets. To address these issues, we propose TSLANet, a lightweight and universal convolutional framework for time series analysis. The model incorporates an Adaptive Spectral Block that leverages Fourier analysis to represent features in both temporal and frequency domains, enabling effective modeling of local and global dependencies while suppressing noise through adaptive thresholding. Furthermore, an Interactive Convolution Block is introduced, and self-supervised learning strategies are employed to enhance temporal representation learning and improve robustness across datasets. Extensive experiments demonstrate that TSLANet achieves state-of-the-art performance in forecasting, classification, and anomaly detection tasks, exhibiting strong adaptability and stability across varying noise intensities and data scales.

Openalex Percentile: Top 99%
Time Series Analysis and Forecasting
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.