Reinforcement learning-based pitch control for wind turbines using double deep Q-networks

This paper presents a novel reinforcement learning-based framework for pitch control in wind turbines, addressing the challenges posed by high nonlinearity and uncertainties in wind dynamics. Traditional pitch control methods, such as proportional-integral controllers, often struggle with adaptability and load mitigation under fluctuating wind conditions. To enhance control efficiency, the proposed framework employs a two-stage approach: policy transfer and policy refinement. In the policy transfer stage, a proportional-integral controller is used to estimate an initial control policy. This policy is then refined using the double deep Q-Network algorithm. Furthermore, a novel reward function is introduced as an improved version of a recent formulation in the literature, ensuring better alignment with practical operational scenarios. Simulations demonstrate that the proposed controller outperforms the industry-standard ROSCO controller, achieving a 15.87% reduction in power fluctuations, while preserving comparable structural load levels, with slight reductions in some cases. These results highlight the potential of reinforcement learning-based control to enhance wind turbine power regulation without compromising structural safety in terms of loads and vibrations.

Authors

Institutions

Publication Details

Journal
ISA Transactions
Published
2026-01-09
DOI
https://doi.org/10.1016/j.isatra.2026.01.015
Primary Topic
Wind Turbine Control Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Reinforcement learning-based pitch control for wind turbines using double deep Q-networks

Carolina Ormaza, Víctor M. Espinoza, CHRISTIAN TUTIVÉN, Yolanda Vidal
ISA Transactions
Wind Turbine Control Systems
article

Reinforcement learning-based pitch control for wind turbines using double deep Q-networks

Carolina Ormaza, Víctor M. Espinoza, CHRISTIAN TUTIVÉN, Yolanda Vidal
article en

Abstract

This paper presents a novel reinforcement learning-based framework for pitch control in wind turbines, addressing the challenges posed by high nonlinearity and uncertainties in wind dynamics. Traditional pitch control methods, such as proportional-integral controllers, often struggle with adaptability and load mitigation under fluctuating wind conditions. To enhance control efficiency, the proposed framework employs a two-stage approach: policy transfer and policy refinement. In the policy transfer stage, a proportional-integral controller is used to estimate an initial control policy. This policy is then refined using the double deep Q-Network algorithm. Furthermore, a novel reward function is introduced as an improved version of a recent formulation in the literature, ensuring better alignment with practical operational scenarios. Simulations demonstrate that the proposed controller outperforms the industry-standard ROSCO controller, achieving a 15.87% reduction in power fluctuations, while preserving comparable structural load levels, with slight reductions in some cases. These results highlight the potential of reinforcement learning-based control to enhance wind turbine power regulation without compromising structural safety in terms of loads and vibrations.

ISA TransactionsVol. 169
Escuela Superior Politecnica del Litoral (EC), Universidad Ecotec (EC), Universitat Politècnica de Catalunya (ES)
Affordable and clean energy
Openalex Percentile: Top 92%
Wind Turbine Control Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Reinforcement learning-based pitch control for wind turbines using double deep Q-networks — Carolina Ormaza, Víctor M. Espinoza, et al. · ISA Transactions (2026) | TGRS Research Map | TGRS