PV and Load Forecasting for Photovoltaic Communities Based on a Hybrid Model of LSTM and Transformer

This paper investigates the PV and load forecasting problem for PV communities. A construction of a PV and load forecasting model based on a hybrid model of LSTM and Transformer is proposed. The multi-attention mechanism of Transformer is added to the traditional neural network LSTM model. This hybrid model optimizes the original data according to the PV and load time series characteristics. The weighted mean square error method is used to design the loss function. In order to prevent model overfitting and improve stability, Adam optimizer and regularization coefficient is introduced. In order to verify the superiority of the model, machine learning and traditional neural network method comparison experiments are carried out in this paper. The experimental results show that the model designed in this paper has the smallest error between the predicted value and the true value. It shows that the model with the introduction of Transformer's multi-attention mechanism in LSTM model can improve the prediction accuracy.

Authors

Institutions

Publication Details

Published
2025-03-26
DOI
https://doi.org/10.1109/icit63637.2025.10965325
Primary Topic
Advanced Decision-Making Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

PV and Load Forecasting for Photovoltaic Communities Based on a Hybrid Model of LSTM and Transformer

Xing Zhang, Zhongyuan Xiao, Chang Xu, Xiang Li et al.
Advanced Decision-Making Techniques
article

PV and Load Forecasting for Photovoltaic Communities Based on a Hybrid Model of LSTM and Transformer

Xing Zhang, Zhongyuan Xiao, Chang Xu, Xiang Li, Qingyi Wang, Jinglong Cen
article en

Abstract

This paper investigates the PV and load forecasting problem for PV communities. A construction of a PV and load forecasting model based on a hybrid model of LSTM and Transformer is proposed. The multi-attention mechanism of Transformer is added to the traditional neural network LSTM model. This hybrid model optimizes the original data according to the PV and load time series characteristics. The weighted mean square error method is used to design the loss function. In order to prevent model overfitting and improve stability, Adam optimizer and regularization coefficient is introduced. In order to verify the superiority of the model, machine learning and traditional neural network method comparison experiments are carried out in this paper. The experimental results show that the model designed in this paper has the smallest error between the predicted value and the true value. It shows that the model with the introduction of Transformer's multi-attention mechanism in LSTM model can improve the prediction accuracy.

China University of Geosciences (CN), Wuhan Ship Development & Design Institute (CN)
Openalex Percentile: Top 90%
Advanced Decision-Making Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.