Multi-Agent Reinforcement Learning Control of a Hydrostatic Wind Turbine-Based Farm

被引:6
|
作者
Huang, Yubo [1 ]
Lin, Shuyue [2 ]
Zhao, Xiaowei [1 ]
机构
[1] Univ Warwick, Sch Engn, Intelligent Control & Smart Energy ICSE Res Grp, Coventry CV4 7AL, England
[2] Univ Hull, Dept Engn, Kingston Upon Hull HU6 7RX, England
关键词
Wind farms; Wind turbines; Reinforcement learning; Power generation; Wind farm control; hydrostatic wind turbines; multi-agent reinforcement learning; power generation;
D O I
10.1109/TSTE.2023.3270761
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
This paper leverages multi-agent reinforcement learning (MARL) to develop an efficient control system for a wind farm comprising a new type of wind turbines with hydrostatic transmission. The primary motivation for hydrostatic wind turbines (HWT) is increased reliability, and reduced manufacturing, operating, and maintaining costs by removing troublesome components and reducing nacelle weight. Nevertheless, the high system complexity of HWT and the wake effect pose significant challenges for the control of HWT-based wind farms. We therefore propose a MARL algorithm named multi-agent policy optimization (MAPO), which allows agents (turbines) to gradually improve their control policies by repeatedly interacting with the environment to learn an optimal operation curve for wind farms. Simulation results based on a wind farm simulator, FAST.Farm, show that MAPO outperforms the greedy policy and a popular learning-based method, multi-agent deep deterministic policy gradient (MADDPG), in terms of power generation.
引用
收藏
页码:2406 / 2416
页数:11
相关论文
共 50 条
  • [21] Cranes control using multi-agent reinforcement learning
    Arai, S
    Miyazaki, K
    Kobayashi, S
    INTELLIGENT AUTONOMOUS SYSTEMS: IAS-5, 1998, : 335 - 342
  • [22] Active Power Control Simulation Platform Research of Wind Farm Based on Multi-Agent
    Liu, Xingjie
    Wang, Kangyuan
    INTERNATIONAL CONFERENCE ON ENGINEERING TECHNOLOGY AND APPLICATION (ICETA 2015), 2015, 22
  • [23] Reinforcement Learning Based Multi-agent LFC Design Concerning the Integration of Wind Farms
    Bevrani, H.
    Daneshfar, F.
    Daneshmand, P. R.
    Hiyama, T.
    2010 IEEE INTERNATIONAL CONFERENCE ON CONTROL APPLICATIONS, 2010, : 567 - 571
  • [24] Coordinated frequency auxiliary control strategy of wind farm and gas turbine on offshore oil and gas platform based on multi-agent
    Meng Q.
    Li R.
    Liu K.
    Han M.
    Li R.
    Dianli Zidonghua Shebei/Electric Power Automation Equipment, 2023, 43 (08): : 105 - 140
  • [25] Intelligent Control of a Wind Turbine based on Reinforcement Learning
    Tomin, Nikita
    Kurbatsky, Victor
    Guliyev, Huseyngulu
    2019 16TH CONFERENCE ON ELECTRICAL MACHINES, DRIVES AND POWER SYSTEMS (ELMA), 2019,
  • [26] Multi-agent cooperative learning research based on reinforcement learning
    Liu, Fei
    Zeng, Guangzhou
    2006 10TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, PROCEEDINGS, VOLS 1 AND 2, 2006, : 1408 - 1413
  • [27] Multi-Agent Reinforcement Learning Based Actuator Control for EV HVAC Systems
    Joo, Sungho
    Lee, Dongmin
    Kim, Minseop
    Lee, Taeho
    Choi, Sanghyeok
    Kim, Seungju
    Lee, Jeyeol
    Kim, Joongjae
    Lim, Yongsub
    Lee, Jeonghoon
    IEEE ACCESS, 2023, 11 : 7574 - 7587
  • [28] Efficient Communication in Multi-Agent Reinforcement Learning via Variance Based Control
    Zhang, Sai Qian
    Zhang, Qi
    Lin, Jieyu
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [29] Optimal control method of HVAC based on multi-agent deep reinforcement learning
    Fu, Qiming
    Chen, Xiyao
    Ma, Shuai
    Fang, Nengwei
    Xing, Bin
    Chen, Jianping
    ENERGY AND BUILDINGS, 2022, 270
  • [30] Multi-agent Reinforcement Learning-Based UAS Control for Logistics Environments
    Jo, Hyungeun
    Lee, Hoeun
    Jeon, Sangwoo
    Kaliappan, Vishnu Kumar
    Nguyen, Tuan Anh
    Min, Dugki
    Lee, Jae-Woo
    PROCEEDINGS OF THE 2021 ASIA-PACIFIC INTERNATIONAL SYMPOSIUM ON AEROSPACE TECHNOLOGY (APISAT 2021), VOL 2, 2023, 913 : 963 - 972