LW-MSTCNN: An Optimization Study on Integrating Multiscale Attention Mechanism with Deep Separable Convolutional Networks

Multivariate time series (MTS) forecasting is crucial in the finance, energy and transportation sectors. Although current models deliver high prediction accuracy, their complexity and extensive computational demands hinder practical deployment. To address these limitations, this paper introduces a lightweight multiscale spatio-temporal convolutional network (LW-MSTCNN) that leverages deep separable convolution (DSCNN) to build an efficient multiscale pyramid model to decrease model complexity and computational costs. Additionally, a multiscale attention (MA) mechanism is incorporated to selectively emphasize important features across different spatial and temporal scales, improving feature extraction and overall performance. This combined approach enhances the model’s ability to process high-dimensional data efficiently while capturing critical multiscale patterns, addressing key challenges in spatio-temporal data processing. Experimental results on four datasets demonstrate that the proposed model significantly reduces the usage of computational resources, with the parameter count reduced by 4 to 5 times, while maintaining comparable prediction accuracy. Additionally, extensive generalization experiments show that the model exhibits strong robustness. This highlights the effectiveness and practicality of the model in multivariate time series (MTS) forecasting.

Authors

Institutions

Publication Details

Published
2025-06-08
DOI
https://doi.org/10.1109/cec65147.2025.11043014
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LW-MSTCNN: An Optimization Study on Integrating Multiscale Attention Mechanism with Deep Separable Convolutional Networks

Lingyao Wang, Yunjie Li, Haifeng Tang, Pengfei Liu et al.
Neural Networks and Applications
article

LW-MSTCNN: An Optimization Study on Integrating Multiscale Attention Mechanism with Deep Separable Convolutional Networks

Lingyao Wang, Yunjie Li, Haifeng Tang, Pengfei Liu, Haitao Zhao, Minxian Shen
article en

Abstract

Multivariate time series (MTS) forecasting is crucial in the finance, energy and transportation sectors. Although current models deliver high prediction accuracy, their complexity and extensive computational demands hinder practical deployment. To address these limitations, this paper introduces a lightweight multiscale spatio-temporal convolutional network (LW-MSTCNN) that leverages deep separable convolution (DSCNN) to build an efficient multiscale pyramid model to decrease model complexity and computational costs. Additionally, a multiscale attention (MA) mechanism is incorporated to selectively emphasize important features across different spatial and temporal scales, improving feature extraction and overall performance. This combined approach enhances the model’s ability to process high-dimensional data efficiently while capturing critical multiscale patterns, addressing key challenges in spatio-temporal data processing. Experimental results on four datasets demonstrate that the proposed model significantly reduces the usage of computational resources, with the parameter count reduced by 4 to 5 times, while maintaining comparable prediction accuracy. Additionally, extensive generalization experiments show that the model exhibits strong robustness. This highlights the effectiveness and practicality of the model in multivariate time series (MTS) forecasting.

Nanjing University of Posts and Telecommunications (CN)
National Natural Science Foundation of China, Research and Development
Openalex Percentile: Top 93%
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.