Optimizing Solar Microgrid Efficiency via Reinforcement Learning: An Empirical Study Using Real-Time Energy Flow and Weather Forecasts

This paper investigates the use of deep reinforcement learning (DRL) to optimize the energy efficiency of a solar-powered microgrid under real-time energy flow and weather forecasting.The research generates a fully synthetic dataset simulating a solar microgrid's hourly photovoltaic (PV) generation, battery state, load demand, and weather-based solar irradiance forecasts.Four RL algorithms are applied and compared: Deep Q-Network (DQN), Proximal Policy Optimization (PPO), Advantage Actor-Critic (A2C), and Deep Deterministic Policy Gradient (DDPG).Each agent learns to control battery charging/discharging actions to balance supply and demand, incorporating solar forecasts to handle uncertainty.Methodology details include dataset generation, environment formulation, and RL training procedures.This paper presents performance metrics (e.g., reward curves, energy utilization) and graphical analyses.In the study's empirical results, PPO and DDPG achieve the highest efficiency under clear conditions, while A2C adapts best to sudden changes; DQN performs robustly but converges more slowly.All DRL agents significantly outperform a rule-based baseline.The study demonstrates that DRL can adaptively manage real-time microgrid operations under weather variability, improving renewable utilization and resilience.This work provides a comprehensive evaluation of modern RL methods for smartenergy systems.

Authors

Institutions

Publication Details

Journal
International Journal of Computer Applications
Published
2025-06-20
DOI
https://doi.org/10.5120/ijca2025925190
Citations
3
Primary Topic
Smart Grid Energy Management
Type
article
Field-Weighted Citation Impact
2.19
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Optimizing Solar Microgrid Efficiency via Reinforcement Learning: An Empirical Study Using Real-Time Energy Flow and Weather Forecasts

Muhammad Ahmed, Abhay Shukla, Indrajit Das
3 citations
International Journal of Computer Applications
Smart Grid Energy Management
2.19
article

Optimizing Solar Microgrid Efficiency via Reinforcement Learning: An Empirical Study Using Real-Time Energy Flow and Weather Forecasts

Muhammad Ahmed, Abhay Shukla, Indrajit Das
article en
3 citations

Abstract

This paper investigates the use of deep reinforcement learning (DRL) to optimize the energy efficiency of a solar-powered microgrid under real-time energy flow and weather forecasting.The research generates a fully synthetic dataset simulating a solar microgrid's hourly photovoltaic (PV) generation, battery state, load demand, and weather-based solar irradiance forecasts.Four RL algorithms are applied and compared: Deep Q-Network (DQN), Proximal Policy Optimization (PPO), Advantage Actor-Critic (A2C), and Deep Deterministic Policy Gradient (DDPG).Each agent learns to control battery charging/discharging actions to balance supply and demand, incorporating solar forecasts to handle uncertainty.Methodology details include dataset generation, environment formulation, and RL training procedures.This paper presents performance metrics (e.g., reward curves, energy utilization) and graphical analyses.In the study's empirical results, PPO and DDPG achieve the highest efficiency under clear conditions, while A2C adapts best to sudden changes; DQN performs robustly but converges more slowly.All DRL agents significantly outperform a rule-based baseline.The study demonstrates that DRL can adaptively manage real-time microgrid operations under weather variability, improving renewable utilization and resilience.This work provides a comprehensive evaluation of modern RL methods for smartenergy systems.

International Journal of Computer ApplicationsVol. 187(13)
Chittagong University of Engineering & Technology (BD), Indian Institute of Technology Kanpur (IN)
Affordable and clean energy
Openalex Percentile: Top 12%
Smart Grid Energy Management
2.19
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.