Heat Transfer and Drag Control in Tandem Circular Cylinders Using PPO-Based Deep Reinforcement Learning for Synthetic-Jet Actuation

This study investigates heat-transfer and drag control in tandem circular cylinders using proximal policy optimization (PPO)-based deep reinforcement learning for closed-loop synthetic-jet actuation. Two-dimensional unsteady laminar computational fluid dynamics simulations were coupled with PPO controllers. Separate policies were trained for six spacing ratios (L/D = 5–10) at Reynolds numbers Re = 100, 150, and 200, using equally weighted heat-transfer and drag objectives. The sum of the percentage drag reductions and heat-transfer changes of both cylinders was positive at all 18 training conditions (5.2–40.3). Upstream heat transfer increased by 2.3–4.4% across all training conditions, while downstream drag reduction reached 49.3%. At Re = 100, downstream heat transfer was largely maintained, whereas higher Reynolds numbers exhibited reduced downstream heat transfer accompanying greater drag reduction, revealing a thermal–aerodynamic trade-off. Representative flow-field analyses associated downstream responses with changes in mean velocity and temperature, and upstream drag responses with distinct vorticity and temperature distributions. This sum remained positive at all 12 untrained conditions at Re = 125 and 175 but decreased markedly at L/D = 9 and 10. These findings highlight the potential and limitations of PPO-based synthetic-jet control for balancing heat-transfer enhancement and drag reduction in tandem-cylinder configurations.

Authors

Institutions

Publication Details

Journal
Energies
Published
2026-11-12
DOI
https://doi.org/10.3390/en19225451
Primary Topic
Plasma and Flow Control in Aerodynamics
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Heat Transfer and Drag Control in Tandem Circular Cylinders Using PPO-Based Deep Reinforcement Learning for Synthetic-Jet Actuation

Hyun Sik Yoon, Myunghun Lee
Energies
Plasma and Flow Control in Aerodynamics
article

Heat Transfer and Drag Control in Tandem Circular Cylinders Using PPO-Based Deep Reinforcement Learning for Synthetic-Jet Actuation

Hyun Sik Yoon, Myunghun Lee
article en

Abstract

This study investigates heat-transfer and drag control in tandem circular cylinders using proximal policy optimization (PPO)-based deep reinforcement learning for closed-loop synthetic-jet actuation. Two-dimensional unsteady laminar computational fluid dynamics simulations were coupled with PPO controllers. Separate policies were trained for six spacing ratios (L/D = 5–10) at Reynolds numbers Re = 100, 150, and 200, using equally weighted heat-transfer and drag objectives. The sum of the percentage drag reductions and heat-transfer changes of both cylinders was positive at all 18 training conditions (5.2–40.3). Upstream heat transfer increased by 2.3–4.4% across all training conditions, while downstream drag reduction reached 49.3%. At Re = 100, downstream heat transfer was largely maintained, whereas higher Reynolds numbers exhibited reduced downstream heat transfer accompanying greater drag reduction, revealing a thermal–aerodynamic trade-off. Representative flow-field analyses associated downstream responses with changes in mean velocity and temperature, and upstream drag responses with distinct vorticity and temperature distributions. This sum remained positive at all 12 untrained conditions at Re = 125 and 175 but decreased markedly at L/D = 9 and 10. These findings highlight the potential and limitations of PPO-based synthetic-jet control for balancing heat-transfer enhancement and drag reduction in tandem-cylinder configurations.

EnergiesVol. 19(22)
Pusan National University (KR)
Pusan National University, Ministry of Trade, Industry and Energy
Plasma and Flow Control in Aerodynamics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon