A multi-agent decision approach for optimal energy allocation in microgrid system

被引:7
|
作者
Huang, Mengxing [1 ,2 ]
Lin, Xudong [1 ,2 ]
Feng, Zikai [1 ,2 ]
Wu, Di [1 ,2 ,3 ]
Shi, Zhiyi [1 ,2 ]
机构
[1] Hainan Univ, Sch Informat & Commun Engn, Haikou 570228, Peoples R China
[2] Hainan Univ, State Key Lab Marine Resource Utilizat South China, Haikou 570228, Peoples R China
[3] Shanghai Jiao Tong Univ, Dept Automat, Shanghai 200240, Peoples R China
关键词
Multi-agent; Smart grid; Optimal allocation;
D O I
10.1016/j.epsr.2023.109399
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this article, we investigate the energy allocation problem for microgrids with energy supply coordination. To meet the requirements of the manufacturing system and reduce the operation cost, we propose a microgrid systems control model based on multi-actor-attention-critic with the curriculum learning (CL-MAAC). More specifically, the allocation problem of energy is fabricated as a Markov decision process (MDP). Meanwhile, all energy supplies are abstracted as multiple independent agents. Then, a multi-actor-attention -critic reinforcement learning (RL) framework is employed for encouraging each agent to coordinate with other agents on the basis of different attention. Besides, a curriculum learning (CL)-based sampling policy is adopted to select the transitions that are more favorable to the model based on the degree of difficulty. This integration method of CL and multi-actor-attention-critic significantly enhance the robustness and effectiveness of the algorithm. A simulation of the energy allocation in the microgrid system has been implemented, which demonstrates the great performance of CL-MAAC.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Multi-agent Deep Reinforcement Learning for Microgrid Energy Scheduling
    Zuo, Zhiqiang
    Li, Zhi
    Wang, Yijing
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 6184 - 6189
  • [42] A Novel Internet of Energy Based Optimal Multi-Agent Control Scheme for Microgrid including Renewable Energy Resources
    Alhasnawi, Bilal Naji
    Jasim, Basil H.
    Rahman, Zain-Aldeen S. A.
    Guerrero, Josep M.
    Esteban, M. Dolores
    INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2021, 18 (15)
  • [43] Scalable multi-agent microgrid negotiations for a transactive energy market
    Janko, Samantha A.
    Johnson, Nathan G.
    APPLIED ENERGY, 2018, 229 : 715 - 727
  • [44] A Multi-Agent Model of Energy Transactions in Microgrid under Equilibrium
    Plett, Eduard
    Das, Sanjoy
    PROCEEDINGS OF 3RD INTERNATIONAL CONFERENCE ON INFORMATION SYSTEM AND DATA MINING (ICISDM 2019), 2019, : 37 - 46
  • [45] Multi-agent approach to modeling and simulation of microgrid operation with vehicle-to-grid system
    Egbue O.
    Uko C.
    Egbue, Ona (egbueo@uscupstate.edu), 1600, Elsevier Inc. (33):
  • [46] Energy Management and Control of Microgrid using Multi-Agent Systems
    Tomar, K. K. Singh
    Singh, S. N.
    2015 IEEE UP SECTION CONFERENCE ON ELECTRICAL COMPUTER AND ELECTRONICS (UPCON), 2015,
  • [47] Operation Optimal Dynamics of a Hybrid Electrical System: Multi-Agent Approach
    Mbodji, Abdoul K.
    Ndiaye, Mamadou L.
    Ndiaye, Mounirou
    Ndiaye, Papa A.
    COMPLEX ADAPTIVE SYSTEMS, 2014, 36 : 454 - 461
  • [48] Optimal Design of Observable Multi-Agent Networks: A Structural System Approach
    Pequito, Sergio
    Rego, Francisco
    Kar, Soummya
    Aguiar, A. Pedro
    Pascoal, Antonio
    Jones, Colin
    2014 EUROPEAN CONTROL CONFERENCE (ECC), 2014, : 1536 - 1541
  • [49] Modelling and optimal management of distributed microgrid using multi-agent systems
    Khan, Muhammad Waseem
    Wang, Jie
    Xiong, Linyun
    Ma, Meiling
    SUSTAINABLE CITIES AND SOCIETY, 2018, 41 : 154 - 169
  • [50] Collaborative optimization of multi-energy multi-microgrid system: A hierarchical trust-region multi-agent reinforcement learning approach
    Xu, Xuesong
    Xu, Kai
    Zeng, Ziyang
    Tang, Jiale
    He, Yuanxing
    Shi, Guangze
    Zhang, Tao
    APPLIED ENERGY, 2024, 375