Deep reinforcement learning control unlocks enhanced heat transfer in turbulent convection

Turbulent convection governs heat transport in both natural and industrial settings, yet optimizing it under extreme conditions remains a significant challenge. Traditional control strategies, such as predefined temperature modulation, struggle to achieve substantial enhancement. Here, we introduce a deep reinforcement learning (DRL) framework that autonomously discovers optimal control policies to maximize heat transfer in turbulent Rayleigh-Bénard convection. By dynamically adjusting wall temperature fluctuations, the DRL agent achieves a heat transfer enhancement of up to 38.5%, exceeding the 20 to 25% limit of conventional methods. The learned strategy reveals a nonlinear state-action relationship, inducing a fully modulated boundary layer regime. Furthermore, we distill the DRL insights into a simplified bang-bang control model, which retains comparable performance (up to 40.0% enhancement) and, crucially, generalizes to unseen, higher Rayleigh number cases without additional training. Our results demonstrate the power of machine learning in turbulence control and reveal a framework with potential for intelligent heat transfer optimization in real-world applications.

Authors

Institutions

Publication Details

Journal
Proceedings of the National Academy of Sciences
Published
2025-09-09
DOI
https://doi.org/10.1073/pnas.2506351122
Citations
8
Primary Topic
Fluid Dynamics and Turbulent Flows
Type
article
Field-Weighted Citation Impact
10.68
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Deep reinforcement learning control unlocks enhanced heat transfer in turbulent convection

Zisong Zhou, Xiaojue Zhu
8 citations
Proceedings of the National Academy of Sciences
Fluid Dynamics and Turbulent Flows
10.68
article

Deep reinforcement learning control unlocks enhanced heat transfer in turbulent convection

Zisong Zhou, Xiaojue Zhu
article en
8 citations

Abstract

Turbulent convection governs heat transport in both natural and industrial settings, yet optimizing it under extreme conditions remains a significant challenge. Traditional control strategies, such as predefined temperature modulation, struggle to achieve substantial enhancement. Here, we introduce a deep reinforcement learning (DRL) framework that autonomously discovers optimal control policies to maximize heat transfer in turbulent Rayleigh-Bénard convection. By dynamically adjusting wall temperature fluctuations, the DRL agent achieves a heat transfer enhancement of up to 38.5%, exceeding the 20 to 25% limit of conventional methods. The learned strategy reveals a nonlinear state-action relationship, inducing a fully modulated boundary layer regime. Furthermore, we distill the DRL insights into a simplified bang-bang control model, which retains comparable performance (up to 40.0% enhancement) and, crucially, generalizes to unseen, higher Rayleigh number cases without additional training. Our results demonstrate the power of machine learning in turbulence control and reveal a framework with potential for intelligent heat transfer optimization in real-world applications.

Proceedings of the National Academy of SciencesVol. 122(37)
Max Planck Institute for Solar System Research (DE)
Openalex Percentile: Top 1%
Fluid Dynamics and Turbulent Flows
10.68
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.