Deep reinforcement learning‑based smart control of solar‑driven power cycle with thermal energy storage: A Los Angeles case study

• DDPG controller stabilized turbine pressure within nearly 4 % and superheat within nearly 0.2 K tolerance range. • Annual mean efficiency improved by approximately 6 percentage points across variable seasonal and daily solar conditions. • Disciplined TES cycles eliminated overcharge and depletion, sustaining reliable storage performance year-round. • GA Pareto front clustered around 2.55 MPa and 10.1–10.7 K superheat for optimal operation. Solar–driven organic Rankine cycles (ORCs) require precise coordination of working fluid superheat, turbine inlet pressure, and net efficiency. Conventional single–loop control cannot effectively manage these tightly coupled objectives. This study introduces a deep deterministic policy gradient (DDPG) supervisory controller, trained using an 8760–hour global horizontal irradiance (GHI) dataset in a MATLAB–CoolProp environment. The reward function penalizes deviations in superheat, pressure, and efficiency. Over a full–year simulation, compared to a fixed–flow baseline, the DRL controller significantly dampened seasonal and transient variability: turbine inlet pressure stayed within around 4 % of 2.5 MPa, superheat within nearly 0.2 K of a + 10 K target, and efficiency between 20 and 30 percentage, improving the annual mean by 6 percentage points. Thermal energy storage exhibited stable, daily state–of–charge cycles, avoiding overcharge and depletion. A genetic algorithm (GA), applied exclusively to DRL–controlled data, mapped the pressure, temperature and efficiency trade space. The Pareto front highlighted non–dominated optima near 2.55 MPa and 10.1–10.7 K, while dominated clusters corresponded to off–design pressure regimes. The integrated DRL-GA framework thus enables consistently optimal ORC operation under variable solar input, enhancing efficiency, stability, and component lifespan, and offering a deployable pathway for advanced renewable energy systems.

Authors

Institutions

Publication Details

Journal
Energy Conversion and Management X
Published
2025-12-19
DOI
https://doi.org/10.1016/j.ecmx.2025.101478
Primary Topic
Thermodynamic and Exergetic Analyses of Power and Cooling Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Deep reinforcement learning‑based smart control of solar‑driven power cycle with thermal energy storage: A Los Angeles case study

Ata Chitsaz, Amirali Nouri, Araz Emami
Energy Conversion and Management X
Thermodynamic and Exergetic Analyses of Power and Cooling Systems
article

Deep reinforcement learning‑based smart control of solar‑driven power cycle with thermal energy storage: A Los Angeles case study

Ata Chitsaz, Amirali Nouri, Araz Emami
article en

Abstract

• DDPG controller stabilized turbine pressure within nearly 4 % and superheat within nearly 0.2 K tolerance range. • Annual mean efficiency improved by approximately 6 percentage points across variable seasonal and daily solar conditions. • Disciplined TES cycles eliminated overcharge and depletion, sustaining reliable storage performance year-round. • GA Pareto front clustered around 2.55 MPa and 10.1–10.7 K superheat for optimal operation. Solar–driven organic Rankine cycles (ORCs) require precise coordination of working fluid superheat, turbine inlet pressure, and net efficiency. Conventional single–loop control cannot effectively manage these tightly coupled objectives. This study introduces a deep deterministic policy gradient (DDPG) supervisory controller, trained using an 8760–hour global horizontal irradiance (GHI) dataset in a MATLAB–CoolProp environment. The reward function penalizes deviations in superheat, pressure, and efficiency. Over a full–year simulation, compared to a fixed–flow baseline, the DRL controller significantly dampened seasonal and transient variability: turbine inlet pressure stayed within around 4 % of 2.5 MPa, superheat within nearly 0.2 K of a + 10 K target, and efficiency between 20 and 30 percentage, improving the annual mean by 6 percentage points. Thermal energy storage exhibited stable, daily state–of–charge cycles, avoiding overcharge and depletion. A genetic algorithm (GA), applied exclusively to DRL–controlled data, mapped the pressure, temperature and efficiency trade space. The Pareto front highlighted non–dominated optima near 2.55 MPa and 10.1–10.7 K, while dominated clusters corresponded to off–design pressure regimes. The integrated DRL-GA framework thus enables consistently optimal ORC operation under variable solar input, enhancing efficiency, stability, and component lifespan, and offering a deployable pathway for advanced renewable energy systems.

Energy Conversion and Management XVol. 29
Urmia University (IR)
Openalex Percentile: Top 58%
Thermodynamic and Exergetic Analyses of Power and Cooling Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.