- Montalà Sales, Ricard
- Font García, Bernat
- Suárez Morales, Pol
- Rabault, Jean
- Lehmkuhl Barba, Oriol
- Vinuesa Motilva, Ricardo
- Rodríguez Pérez, Ivette María
This study investigates the application of deep reinforcement learning (DRL) for active flow control in a three-dimensional NACA0012 wing section with periodic spanwise boundary conditions at low Reynolds number (𝑅𝑒𝑐 =1000) and high angle of attack (AoA =20∘), where the flow exhibits massive separation, strong vortex shedding and a chaotic three-dimensional wake. The baseline configuration is validated against previous numerical studies, showing the accuracy of the computational set-up. Two DRL control policies are trained with different reward functions, leading to fundamentally different control strategies. The DRL set-up uses a multi-agent reinforcement learning framework to coordinate distributed actuators along the wing span. In the first case study, when the reward prioritises drag reduction, agents delay the leading-edge separation and stabilise the wake, reducing drag by 21.1 % and lift fluctuations by 54.1 % while maintaining baseline lift. In the second case, when the reward targets lift enhancement instead, agents synchronise actuations with vortex shedding, forming leading-edge instabilities that increase lift by 42.3 %, albeit at the cost of higher fluctuations and slightly increased drag. A comparison with classical open-loop control further demonstrates that DRL autonomously determines physically meaningful and interpretable strategies consistent with established mechanisms in the literature. To the best of the authors’ knowledge, this is the first study in which a fully three-dimensional computational fluid dynamics simulation has been employed to train a DRL model for active flow control in wings, suggesting promising directions for extending DRL-based strategies to higher Reynolds numbers and more complex wing configurations where prior physical knowledge may be limited., This research was partially funded by the Ministerio de Ciencia e Innovación of Spain (PID2023-150408OB-C21 and PID2023-150408OB-C22). Work has also been co-funded by the European High Performance Computing Joint Undertaking, together with Germany, Italy, Slovenia, Spain, Sweden and France under grant agreement No 101092621; and under grant PCI2022-135085-2, funded by MICIU/AEI/10.13039/501100011033 and by the ‘European Union NextGenerationEU/PRTR’. R. Montalà’s work was supported by a contract from the Agència d’Ajuts Universitaris i Recerca of the Generalitat de Catalunya through a FI-SDUR grant (2022 FISDU 00066). O. Lehmkuhl has been partially supported by a Ramón y Cajal postdoctoral contract (RYC2018-025949-I). The authors also acknowledge the support of the Agència d’Ajuts Universitaris i Recerca of the Generalitat de Catalunya to the research groups Large-scale Computational Fluid Dynamics (2021 SGR 00902) and Turbulence and Aerodynamics Research Group (2021 SGR 01051). R. Vinuesa acknowledges financial support from the European Research Council under grant no. 2021-CoG101043998, DEEPCONTROL. The views and opinions expressed are those of the authors only and do not necessarily reflect those of the European Union or the European Research Council., Peer Reviewed, Postprint (published version)