A multi-agent decision approach for optimal energy allocation in microgrid system

被引:7
|
作者
Huang, Mengxing [1 ,2 ]
Lin, Xudong [1 ,2 ]
Feng, Zikai [1 ,2 ]
Wu, Di [1 ,2 ,3 ]
Shi, Zhiyi [1 ,2 ]
机构
[1] Hainan Univ, Sch Informat & Commun Engn, Haikou 570228, Peoples R China
[2] Hainan Univ, State Key Lab Marine Resource Utilizat South China, Haikou 570228, Peoples R China
[3] Shanghai Jiao Tong Univ, Dept Automat, Shanghai 200240, Peoples R China
关键词
Multi-agent; Smart grid; Optimal allocation;
D O I
10.1016/j.epsr.2023.109399
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this article, we investigate the energy allocation problem for microgrids with energy supply coordination. To meet the requirements of the manufacturing system and reduce the operation cost, we propose a microgrid systems control model based on multi-actor-attention-critic with the curriculum learning (CL-MAAC). More specifically, the allocation problem of energy is fabricated as a Markov decision process (MDP). Meanwhile, all energy supplies are abstracted as multiple independent agents. Then, a multi-actor-attention -critic reinforcement learning (RL) framework is employed for encouraging each agent to coordinate with other agents on the basis of different attention. Besides, a curriculum learning (CL)-based sampling policy is adopted to select the transitions that are more favorable to the model based on the degree of difficulty. This integration method of CL and multi-actor-attention-critic significantly enhance the robustness and effectiveness of the algorithm. A simulation of the energy allocation in the microgrid system has been implemented, which demonstrates the great performance of CL-MAAC.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] A multi-agent system approach for optimal microgrid expansion planning under uncertainty
    Mishra, Sambeet
    Bordin, Chiara
    Tomasgard, Asgeir
    Palu, Ivo
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2019, 109 : 696 - 709
  • [2] Energy Management of a Multi-Agent Based Multi-Microgrid System
    Ren, J. S.
    Tan, K. T.
    Sivaneasan, B.
    So, P. L.
    Gunawan, E.
    2014 IEEE PES ASIA-PACIFIC POWER AND ENERGY ENGINEERING CONFERENCE (IEEE PES APPEEC), 2014,
  • [3] Optimal allocation of microgrid using a differential multi-agent multi-objective evolution algorithm
    Liu, Liheng
    Niu, Miaomiao
    Zhang, Dongliang
    Liu, Li
    Frank, Dietmar
    APPLIED MATHEMATICS AND NONLINEAR SCIENCES, 2021, 6 (02) : 111 - 124
  • [4] Intelligent multi-agent system for smart microgrid energy management
    Elamine, Didi Omar
    Nfaoui, El Habib
    Boumhidi, Jaouad
    INTERNATIONAL JOURNAL OF INTELLIGENT ENGINEERING INFORMATICS, 2016, 4 (3-4) : 245 - 266
  • [5] A Multi-agent based Optimal Operation for Microgrid
    Nagata, Takeshi
    Okamoto, Kazuya
    2014 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2014, : 3791 - 3796
  • [6] Application of multi-agent system in a microgrid
    Zhang, Jian
    Ai, Qian
    Wang, Xingang
    2008, Automation of Electric Power Systems Press (32):
  • [7] Multi-Agent Reinforcement Learning Approach for Residential Microgrid Energy Scheduling
    Fang, Xiaohan
    Wang, Jinkuan
    Song, Guanru
    Han, Yinghua
    Zhao, Qiang
    Cao, Zhiao
    ENERGIES, 2020, 13 (01)
  • [8] Optimal Scheduling of Integrated Energy Microgrid Under the Background of Multi-agent Game
    Song X.
    Chen J.
    Shi Q.
    Gaodianya Jishu/High Voltage Engineering, 2023, 49 (08): : 3163 - 3178
  • [9] Multi-Agent Approach for Real-Time Optimal Control of Electro Microgrid
    Shikhin, V. A.
    Abd Elraheem, A. K.
    Ren, J.
    2018 INTERNATIONAL SCIENTIFIC MULTI-CONFERENCE ON INDUSTRIAL ENGINEERING AND MODERN TECHNOLOGIES (FAREASTCON), 2018,
  • [10] Multi-Agent Optimal Allocation of Energy Storage Systems in Distribution Systems
    Zheng, Yu
    Hill, David J.
    Dong, Zhao Yang
    IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2017, 8 (04) : 1715 - 1725