MoRAM for Multi-Step and Multivariate Short-Term Wind-Power Forecasting: A Reproducibility Audit and Corrected Attention Ablation

Accurate short-term wind-power forecasting supports renewable-energy integration. This study presents a reproducibility and implementation audit of MoRAM, an integrated architecture that combines feature-token attention, a residual Mamba layer, dense two-expert blending, and a one-dimensional convolution (Conv1D)–linear residual output path to forecast 12 h of normalized turbine power from 48 h multivariate histories in Dataset A (200 turbines; 8760 hourly records). Source reconstruction found that the historical PyTorch attention layer used its default sequence-major interface on batch-major data, thereby mixing samples; the dense-window record is therefore retained only as an implementation audit. We corrected the layer to batch-first feature-token semantics and ran an attention-only ablation using all turbines, a 12 h window-start stride, and five paired seeds. Corrected MoRAM achieved mean absolute error (MAE) 0.2428 ± 0.0029 per unit (p.u.) and root-mean-square error (RMSE) 0.3035 ± 0.0059 p.u.; bypassing only attention achieved MAE 0.2298 ± 0.0027 p.u. and RMSE 0.2839 ± 0.0028 p.u. (mean ± sample standard deviation). The attention-free condition had lower overall MAE and RMSE in every seed and, after averaging across seeds, at every forecast horizon. The principal validated contribution is therefore an auditable reconstruction—complete data protocol, source/log mapping, corrected tensor semantics, and a reproducible five-seed negative ablation—rather than evidence that every constituent module or the integrated architecture is superior.

Authors

Institutions

Publication Details

Journal
Energies
Published
2026-08-25
DOI
https://doi.org/10.3390/en19173977
Primary Topic
Energy Load and Power Forecasting
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

MoRAM for Multi-Step and Multivariate Short-Term Wind-Power Forecasting: A Reproducibility Audit and Corrected Attention Ablation

Tianyang Wang, Limei Ma, Zizhen Tang, Baochen Zhen et al.
Energies
Energy Load and Power Forecasting
article

MoRAM for Multi-Step and Multivariate Short-Term Wind-Power Forecasting: A Reproducibility Audit and Corrected Attention Ablation

Tianyang Wang, Limei Ma, Zizhen Tang, Baochen Zhen, Yunuo Shao, Yong Zhao, Xiaotian Lu, Zhile Xiong, Kaidi Xu
article en

Abstract

Accurate short-term wind-power forecasting supports renewable-energy integration. This study presents a reproducibility and implementation audit of MoRAM, an integrated architecture that combines feature-token attention, a residual Mamba layer, dense two-expert blending, and a one-dimensional convolution (Conv1D)–linear residual output path to forecast 12 h of normalized turbine power from 48 h multivariate histories in Dataset A (200 turbines; 8760 hourly records). Source reconstruction found that the historical PyTorch attention layer used its default sequence-major interface on batch-major data, thereby mixing samples; the dense-window record is therefore retained only as an implementation audit. We corrected the layer to batch-first feature-token semantics and ran an attention-only ablation using all turbines, a 12 h window-start stride, and five paired seeds. Corrected MoRAM achieved mean absolute error (MAE) 0.2428 ± 0.0029 per unit (p.u.) and root-mean-square error (RMSE) 0.3035 ± 0.0059 p.u.; bypassing only attention achieved MAE 0.2298 ± 0.0027 p.u. and RMSE 0.2839 ± 0.0028 p.u. (mean ± sample standard deviation). The attention-free condition had lower overall MAE and RMSE in every seed and, after averaging across seeds, at every forecast horizon. The principal validated contribution is therefore an auditable reconstruction—complete data protocol, source/log mapping, corrected tensor semantics, and a reproducible five-seed negative ablation—rather than evidence that every constituent module or the integrated architecture is superior.

EnergiesVol. 19(17)
Beijing Institute of Petrochemical Technology (CN), University of Nottingham Ningbo China (CN), Harbin Institute of Technology (CN), Beijing Academy of Science and Technology (CN), Tsinghua University (CN)
National Natural Science Foundation of China, Natural Science Foundation of Beijing Municipality
Affordable and clean energy
Openalex Percentile: Top 19%
Energy Load and Power Forecasting
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.