A multi-agent reinforcement learning method for distribution system restoration considering dynamic network reconfiguration

被引:2
|
作者
Si, Ruiqi [1 ]
Chen, Siyuan [1 ]
Zhang, Jun [1 ]
Xu, Jian [1 ]
Zhang, Luxi [2 ]
机构
[1] Wuhan Univ, Sch Elect Engn & Automat, Wuhan 430072, Peoples R China
[2] Brandeis Univ, Waltham, MA 02454 USA
基金
国家重点研发计划;
关键词
Deep reinforcement learning; Multi-agent reinforcement learning; Distribution system restoration; Distribution network; Microgrid; UNBALANCED DISTRIBUTION-SYSTEMS; SERVICE RESTORATION; MANAGEMENT; MODEL;
D O I
10.1016/j.apenergy.2024.123625
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Extreme weather, chain failures, and other events have increased the probability of wide-area blackouts, which highlights the importance of rapidly and efficiently restoring the affected loads. This paper proposes a multi-agent reinforcement learning method for distribution system restoration. Firstly, considering that the topology of the distribution system may change during network reconfiguration, a dynamic agent network (DAN) architecture is designed to address the challenge of input dimensions changing in neural network. Two encoders are created to capture observations of the environment and other agents respectively, and an attention mechanism is used to aggregate an arbitrary-sized neighboring agent feature set. Then, considering the operation constraints of the DSR, an action mask mechanism is implemented to filter out invalid actions, ensuring the security of the strategy. Finally, an IEEE 123-node test system is used for validation, and the experimental results showed that the proposed algorithm can effectively assist agents in accomplishing collaborative DSR tasks.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] A Two-Stage Multi-Agent Deep Reinforcement Learning Method for Urban Distribution Network Reconfiguration Considering Switch Contribution
    Gao, Hongjun
    Jiang, Siyuan
    Li, Zhengmao
    Wang, Renjun
    Liu, Youbo
    Liu, Junyong
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2024, 39 (06) : 7064 - 7076
  • [2] A multi-agent system for dynamic network reconfiguration
    Maj, A
    Jurowicz, J
    Kozlak, J
    Cetnarowicz, K
    MULTI-AGENT SYSTEMS AND APPLICATIONS III, PROCEEDINGS, 2003, 2691 : 511 - 521
  • [3] Multi-Agent Reinforcement Learning for Distribution System Critical Load Restoration
    Yao, Yiyun
    Zhang, Xiangyu
    Wang, Jiyu
    Ding, Fei
    2023 IEEE POWER & ENERGY SOCIETY GENERAL MEETING, PESGM, 2023,
  • [4] A Multi-agent Restoration method for Distribution Network
    Yokoyama, Tsukasa
    Nagata, Takeshi
    2011 2ND INTERNATIONAL CONFERENCE ON ADVANCES IN ENERGY ENGINEERING (ICAEE), 2012, 14 : 726 - 731
  • [5] A novel approach for dynamic reconfiguration of the distribution network via multi-agent system
    Li, Zhenkun
    Chen, Xingying
    Yu, Kun
    Zhao, Bo
    Liu, Haoming
    2008 THIRD INTERNATIONAL CONFERENCE ON ELECTRIC UTILITY DEREGULATION AND RESTRUCTURING AND POWER TECHNOLOGIES, VOLS 1-6, 2008, : 1305 - 1311
  • [6] A Self-Learning Evolutionary Multi-Agent System for Distribution Network Reconfiguration
    Sun, Hongbin
    Ding, Yongsheng
    ADVANCED MEASUREMENT AND TEST, PARTS 1 AND 2, 2010, 439-440 : 1209 - +
  • [7] Dynamic reconfiguration of the distribution network based on multi-agent systems
    College of Electrical Engineering, Hohai University, Nanjing 210098, China
    Zhongguo Dianji Gongcheng Xuebao, 2008, 34 (72-79):
  • [8] A Method for Solving Reconfiguration Blueprints Based on Multi-Agent Reinforcement Learning
    Cheng, Jing
    Tan, Wen
    Lv, Guangzhe
    Li, Guodong
    Zhang, Wentao
    Liu, Zihao
    COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2024, 21 (04)
  • [9] A Cloud-Edge Collaboration Solution for Distribution Network Reconfiguration Using Multi-Agent Deep Reinforcement Learning
    Gao, Hongjun
    Wang, Renjun
    He, Shuaijia
    Wang, Lingfeng
    Liu, Junyong
    Chen, Zhe
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2024, 39 (02) : 3867 - 3879
  • [10] Dynamic Distribution Network Reconfiguration Using Reinforcement Learning
    Gao, Yuanqi
    Shi, Jie
    Wang, Wei
    Yu, Nanpeng
    2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, CONTROL, AND COMPUTING TECHNOLOGIES FOR SMART GRIDS (SMARTGRIDCOMM), 2019,