A Hybrid Transformer–Mamba Model for Multivariate Metro Energy Consumption Forecasting

With the rapid growth of urban populations and the expansion of metro networks, accurate energy consumption prediction has become a critical task for optimizing metro operations and supporting low-carbon city development. Traditional statistical and machine learning methods often struggle to model the complex, nonlinear, and time-varying nature of metro energy data. To address these challenges, this paper proposes MTMM, a novel hybrid model that integrates the multi-head attention mechanism of the Transformer with the efficient, state-space-based Mamba architecture. The Transformer effectively captures long-range temporal dependencies, while Mamba enhances inference speed and reduces complexity. Additionally, the model incorporates multivariate energy features, leveraging the correlations among different energy consumption types to improve predictive performance. Experimental results on real-world data from the Guangzhou Metro demonstrate that MTMM significantly outperforms existing methods in terms of both MAE and MSE. The model also shows strong generalization ability across different prediction lengths and time step configurations, offering a promising solution for intelligent energy management in metro systems.

Authors

Institutions

Publication Details

Journal
Electronics
Published
2025-07-26
DOI
https://doi.org/10.3390/electronics14152986
Primary Topic
Energy Load and Power Forecasting
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Hybrid Transformer–Mamba Model for Multivariate Metro Energy Consumption Forecasting

Junqian Wu, Fan Feng, Ronghui Zhang, Zirui Zhang et al.
Electronics
Energy Load and Power Forecasting
article

A Hybrid Transformer–Mamba Model for Multivariate Metro Energy Consumption Forecasting

Junqian Wu, Fan Feng, Ronghui Zhang, Zirui Zhang, Zhiyao Chen, Qing Fu, L Jiang -Long
article en

Abstract

With the rapid growth of urban populations and the expansion of metro networks, accurate energy consumption prediction has become a critical task for optimizing metro operations and supporting low-carbon city development. Traditional statistical and machine learning methods often struggle to model the complex, nonlinear, and time-varying nature of metro energy data. To address these challenges, this paper proposes MTMM, a novel hybrid model that integrates the multi-head attention mechanism of the Transformer with the efficient, state-space-based Mamba architecture. The Transformer effectively captures long-range temporal dependencies, while Mamba enhances inference speed and reduces complexity. Additionally, the model incorporates multivariate energy features, leveraging the correlations among different energy consumption types to improve predictive performance. Experimental results on real-world data from the Guangzhou Metro demonstrate that MTMM significantly outperforms existing methods in terms of both MAE and MSE. The model also shows strong generalization ability across different prediction lengths and time step configurations, offering a promising solution for intelligent energy management in metro systems.

ElectronicsVol. 14(15)
Sun Yat-sen University (CN), Guangzhou Metro Group (China) (CN)
National Natural Science Foundation of China, Basic and Applied Basic Research Foundation of Guangdong Province
Openalex Percentile: Top 83%
Energy Load and Power Forecasting
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Hybrid Transformer–Mamba Model for Multivariate Metro Energy Consumption Forecasting — Junqian Wu, Fan Feng, et al. · Electronics (2025) | TGRS Research Map | TGRS