Reinforcement-learning-based control of turbulent channel flows at high Reynolds numbers

Abstract Deep reinforcement learning (DRL) is employed to develop control strategies for drag reduction in direct numerical simulations of turbulent channel flows at high Reynolds numbers. The DRL agent uses near-wall streamwise velocity fluctuations as input to modulate wall blowing and suction velocities. These DRL-based strategies achieve significant drag reduction, with maximum rates $35.6\,\%$ at $Re_{\tau }\thickapprox 180$ , $30.4\,\%$ at $Re_{\tau }\thickapprox 550$ , and $27.7\,\%$ at $Re_{\tau }\thickapprox 1000$ , outperforming traditional opposition control methods. An expanded range of wall actions further enhances drag reduction, although effectiveness decreases at higher Reynolds numbers. The DRL models elevate the virtual wall through blowing and suction, aiding in drag reduction. However, at higher Reynolds numbers, the amplitude modulation of large-scale structures significantly increases the residual Reynolds stress on the virtual wall, diminishing the drag reduction. Analysis of budget equations provides a systematic understanding of the underlying drag reduction dynamics. The DRL models reduce skin friction by inhibiting the redistribution of wall-normal turbulent kinetic energy. This further suppresses the wall-normal velocity fluctuations, reducing the production of Reynolds stress, thereby decreasing skin friction. This study showcases the successful application of DRL in turbulence control at high Reynolds numbers, and elucidates the nonlinear control mechanisms underlying the observed drag reduction.