| Title: |
Towards fine tuning wake steering policies in the field: an imitation-based approach |
| Authors: |
Bizon Monroc, Claire; Bušić, Ana; Dubuc, Donatien; Zhu, Jiamin |
| Contributors: |
IFP Energies nouvelles (IFPEN); Apprentissage, graphes et optimisation distribuée (ARGO); Département d'informatique - ENS-PSL (DI-ENS); École normale supérieure - Paris (ENS-PSL); Université Paris Sciences et Lettres (PSL)-Université Paris Sciences et Lettres (PSL)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-École normale supérieure - Paris (ENS-PSL); Université Paris Sciences et Lettres (PSL)-Université Paris Sciences et Lettres (PSL)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Centre Inria de Paris; Institut National de Recherche en Informatique et en Automatique (Inria); Laboratory of Information, Network and Communication Sciences (LINCS); Institut National de Recherche en Informatique et en Automatique (Inria)-Institut Mines-Télécom Paris (IMT)-Sorbonne Université (SU); Funding provided through the France 2030 Plan, PEPR TASE, AI-NRGY project ANR-22-PETA-0044 is gratefully acknowledged.; ANR-22-PETA-0004,AI-NRGY,Distributed AI-based architecture of future energy systems integrating very large amounts of distributed sources(2022) |
| Source: |
ISSN: 1742-6588 ; EISSN: 1742-6596. |
| Publisher Information: |
CCSD; IOP Science |
| Publication Year: |
2024 |
| Subject Terms: |
[PHYS.PHYS.PHYS-COMP-PH]Physics [physics]/Physics [physics]/Computational Physics [physics.comp-ph] |
| Description: |
International audience ; Yaw misalignment strategies can increase the power output of wind farms by mitigating wake effects, but finding optimal yaws requires overcoming both modeling errors and the growing complexity of the problem as the size of the farm grows. Recent works have therefore proposed decentralized multi-agent reinforcement learning (MARL) as a model-free, data-based alternative to learn online. These solutions have led to significant increases in total power production on experiments with both static and dynamic wind farms simulators. Yet experiments in dynamic simulations suggest that convergence time remains too long for online learning on real wind farms. As an improvement, baseline policies obtained by optimizing offline through steady-state models can be fed as inputs to an online reinforcement learning algorithm. This method however does not guarantee a smooth transfer of the policies to the real wind farm. This is aggravated when using function approximation approaches such as multi-layer neural networks to estimate policies and value functions. We propose an imitation approach, where learning a policy is first considered a supervised learning problem by deriving references from steady-state wind farm models, and then as an online reinforcement learning task for adaptation in the field. This approach leads to significant increases in the amount of energy produced over a lookup table (LUT) baseline on experiments done with the mid-fidelity dynamic simulator FAST.Farm under both static and varying wind conditions. |
| Document Type: |
article in journal/newspaper |
| Language: |
English |
| DOI: |
10.1088/1742-6596/2767/3/032017 |
| Availability: |
https://ifp.hal.science/hal-04653089; https://ifp.hal.science/hal-04653089v1/document; https://ifp.hal.science/hal-04653089v1/file/Toward_fine_tuning.pdf; https://doi.org/10.1088/1742-6596/2767/3/032017 |
| Rights: |
http://creativecommons.org/licenses/by/ ; info:eu-repo/semantics/OpenAccess |
| Accession Number: |
edsbas.BC906700 |
| Database: |
BASE |