Leveraging Pretrained Large Language Models for Power System Source-Load Forecasting

With the increasing penetration of renewable energy in power systems, high-precision and adaptive power forecasting is crucial for system stability. Traditional forecasting methods face challenges in capturing nonlinear relationships and adapting to dynamic conditions. This paper explores the use of large language models (LLM) for source-load forecasting, focusing on the cross-modal transferability of LLM weights and their effectiveness in forecasting applications. The proposed framework employs a time-series-driven fine-tuning strategy, which freezes attention weights, adjusts layer normalization, and uses data window slicing to enhance the model's ability to capture nonlinear patterns. A modular covariate fusion architecture is introduced to better integrate meteorological data. Through experimental validation, the framework demonstrates strong cross-modal transferability and practical forecasting performance across diverse scenarios, highlighting the potential of LLMs in improving source-load forecasting in power systems.

Authors

Institutions

Publication Details

Published
2025-07-04
DOI
https://doi.org/10.1109/icpet66029.2025.11160348
Citations
1
Primary Topic
Power Systems and Technologies
Type
article
Field-Weighted Citation Impact
0.73
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Leveraging Pretrained Large Language Models for Power System Source-Load Forecasting

Shuangjian Peng, Zhuo Xu, Jianbo Xiao, Cunyao Shan et al.
1 citations
Power Systems and Technologies
0.73
article

Leveraging Pretrained Large Language Models for Power System Source-Load Forecasting

Shuangjian Peng, Zhuo Xu, Jianbo Xiao, Cunyao Shan, Wenjing Zhang, Ziyue Wang, Shuai Liu
article en
1 citations

Abstract

With the increasing penetration of renewable energy in power systems, high-precision and adaptive power forecasting is crucial for system stability. Traditional forecasting methods face challenges in capturing nonlinear relationships and adapting to dynamic conditions. This paper explores the use of large language models (LLM) for source-load forecasting, focusing on the cross-modal transferability of LLM weights and their effectiveness in forecasting applications. The proposed framework employs a time-series-driven fine-tuning strategy, which freezes attention weights, adjusts layer normalization, and uses data window slicing to enhance the model's ability to capture nonlinear patterns. A modular covariate fusion architecture is introduced to better integrate meteorological data. Through experimental validation, the framework demonstrates strong cross-modal transferability and practical forecasting performance across diverse scenarios, highlighting the potential of LLMs in improving source-load forecasting in power systems.

Hunan Xiangdian Test Research Institute (China) (CN), Zhejiang University (CN)
Openalex Percentile: Top 23%
Power Systems and Technologies
0.73
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Leveraging Pretrained Large Language Models for Power System Source-Load Forecasting — Shuangjian Peng, Zhuo Xu, et al. · (2025) | TGRS Research Map | TGRS