Efficient navigation of cargo-towing microswimmer in non-uniform flow fields

The vision of deploying miniature vehicles within the human body for intricate tasks holds tremendous promise across engineering and medical domains. Herein, optimal navigation of a cargo-towing swimmer under an applied zig-zag flow is studied by employing direct numerical simulations coupled with a deep reinforcement learning algorithm. Tasks include navigation in flow and shear-gradient directions. We initially explore combinations of state inputs, finding that optimal navigation necessitates swimmers to perceive hydrodynamics and alignment, surpassing reliance solely on hydrodynamic signals while considering their memories. Next, we study combinations of action spaces, allowing dynamic changes in swimming and/or rotational velocities by tuning <a:math xmlns:a="http://www.w3.org/1998/Math/MathML"><a:msub><a:mi>B</a:mi><a:mn>1</a:mn></a:msub></a:math> and <b:math xmlns:b="http://www.w3.org/1998/Math/MathML"><b:msub><b:mi>C</b:mi><b:mn>1</b:mn></b:msub></b:math> parameters of the squirmer model, respectively. By keeping both parameters fixed, cargo-towing swimmers demonstrate superior performance in the flow direction compared to swimmers without load due to tumbling movements influenced by shear flow. In the shear-gradient direction, swimmers without load outperform cargo-towing swimmers, with performance decreasing as load length increases. Across the combination of allowing <c:math xmlns:c="http://www.w3.org/1998/Math/MathML"><c:msub><c:mi>B</c:mi><c:mn>1</c:mn></c:msub></c:math> and <d:math xmlns:d="http://www.w3.org/1998/Math/MathML"><d:msub><d:mi>C</d:mi><d:mn>1</d:mn></d:msub></d:math> to change, the policies from solely dynamic <e:math xmlns:e="http://www.w3.org/1998/Math/MathML"><e:msub><e:mi>B</e:mi><e:mn>1</e:mn></e:msub></e:math> actions demonstrate superior navigation. The policies are then used as a showcase against naive cargo-towing and inert colloidal chains. A t-distributed stochastic neighbor embedding analysis reveals the complex interplay between perceived hydrodynamic signals and swimmer position. In the flow direction, swimmers align effectively with regions of maximum velocity, while in the shear-gradient direction, periodic transitions from minimum to maximum state values occur. Comparing pullers, pushers, and neutral swimmers, cargo-towing swimmers show a reversal in swimming velocity trends, with pullers outpacing neutral and pusher swimmers, irrespective of load lengths. Published by the American Physical Society 2024