A Hybrid Transformer–Mamba Model for Multivariate Metro Energy Consumption Forecasting
With the rapid growth of urban populations and the expansion of metro networks, accurate energy consumption prediction has become a critical task for optimizing metro operations and supporting low-carbon city development. Traditional statistical and machine learning methods often struggle to model the complex, nonlinear, and time-varying nature of metro energy data. To address these challenges, this paper proposes MTMM, a novel hybrid model that integrates the multi-head attention mechanism of the Transformer with the efficient, state-space-based Mamba architecture. The Transformer effectively captures long-range temporal dependencies, while Mamba enhances inference speed and reduces complexity. Additionally, the model incorporates multivariate energy features, leveraging the correlations among different energy consumption types to improve predictive performance. Experimental results on real-world data from the Guangzhou Metro demonstrate that MTMM significantly outperforms existing methods in terms of both MAE and MSE. The model also shows strong generalization ability across different prediction lengths and time step configurations, offering a promising solution for intelligent energy management in metro systems.
Authors
- Junqian Wu (ORCID: https://orcid.org/0000-0002-3812-7205)
- Fan Feng (ORCID: https://orcid.org/0000-0002-6559-4028)
- Ronghui Zhang (ORCID: https://orcid.org/0000-0001-6107-4044)
- Zirui Zhang (ORCID: https://orcid.org/0000-0002-8489-1482)
- Zhiyao Chen
- Qing Fu (ORCID: https://orcid.org/0000-0001-9261-3012)
- L Jiang -Long
Institutions
- Sun Yat-sen University (CN)
- Guangzhou Metro Group (China) (CN)
Publication Details
- Journal
- Electronics
- Published
- 2025-07-26
- DOI
- https://doi.org/10.3390/electronics14152986
- Primary Topic
- Energy Load and Power Forecasting
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Basic and Applied Basic Research Foundation of Guangdong Province