Embedding Temporal Awareness in Reinforcement Learning Models for Energy System Control

A reinforcement learning (RL) agent can capture energy system dynamics from historical data to improve its decision-making.However, the RL agent struggles to fully understand temporal patterns in scenarios with high fluctuations.This study addresses this gap by embedding temporal awareness into RL agents for energy system control.The proposed approach integrates generation and load time series into the state representation using a temporal embedding module based on long short-term memory (LSTM).The method is evaluated on highly variable patterns from the Netherlands to demonstrate the performance of temporal RL decision-making in different conditions.

Authors

Institutions

Publication Details

Published
2025-06-16
DOI
https://doi.org/10.1145/3679240.3734686
Citations
1
Primary Topic
Smart Grid Energy Management
Type
article
Field-Weighted Citation Impact
0.73
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Embedding Temporal Awareness in Reinforcement Learning Models for Energy System Control

Johann L. Hurink, Ian Gibson, Amirhossein Heydarian Ardakani, Elham Shirazi
1 citations
Smart Grid Energy Management
0.73
article

Embedding Temporal Awareness in Reinforcement Learning Models for Energy System Control

Johann L. Hurink, Ian Gibson, Amirhossein Heydarian Ardakani, Elham Shirazi
article en
1 citations

Abstract

A reinforcement learning (RL) agent can capture energy system dynamics from historical data to improve its decision-making.However, the RL agent struggles to fully understand temporal patterns in scenarios with high fluctuations.This study addresses this gap by embedding temporal awareness into RL agents for energy system control.The proposed approach integrates generation and load time series into the state representation using a temporal embedding module based on long short-term memory (LSTM).The method is evaluated on highly variable patterns from the Netherlands to demonstrate the performance of temporal RL decision-making in different conditions.

University of Twente (NL)
Affordable and clean energy
Openalex Percentile: Top 27%
Smart Grid Energy Management
0.73
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Embedding Temporal Awareness in Reinforcement Learning Models for Energy System Control — Johann L. Hurink, Ian Gibson, et al. · (2025) | TGRS Research Map | TGRS