A Generalized Deep Reinforcement Learning Model for Distribution Network Reconfiguration with Power Flow-Based Action-Space Sampling

被引:0
|
作者
Gholizadeh, Nastaran [1 ]
Musilek, Petr [1 ]
机构
[1] Univ Alberta, Elect & Comp Engn, Edmonton, AB T6G 1H9, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
data-driven control; deep reinforcement learning; distribution network reconfiguration; deep Q-learning; dueling deep Q-learning; DYNAMIC RECONFIGURATION; DISTRIBUTION-SYSTEMS; DATA-DRIVEN; OPTIMIZATION; ENHANCEMENT; DG;
D O I
10.3390/en17205187
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Distribution network reconfiguration (DNR) is used by utilities to enhance power system performance in various ways, such as reducing line losses. Conventional DNR algorithms rely on accurate values of network parameters and lack scalability and optimality. To tackle these issues, a new data-driven algorithm based on reinforcement learning is developed for DNR in this paper. The proposed algorithm comprises two main parts. The first part, named action-space sampling, aims at analyzing the network structure, finding all feasible reconfiguration actions, and reducing the size of the action space to only the most optimal actions. In the second part, deep Q-learning (DQN) and dueling DQN methods are used to train an agent to take the best switching actions according to the switch states and loads of the system. The results show that both DQN and dueling DQN are effective in reducing system losses through grid reconfiguration. The proposed methods have faster execution time compared to the conventional methods and are more scalable.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] A Comparative Study of Reinforcement Learning Algorithms for Distribution Network Reconfiguration With Deep Q-Learning-Based Action Sampling
    Gholizadeh, Nastaran
    Kazemi, Nazli
    Musilek, Petr
    IEEE ACCESS, 2023, 11 : 13714 - 13723
  • [2] Crowd evacuation guidance based on combined action-space deep reinforcement learning
    Xue Y.
    Wu R.
    Liu J.
    Harbin Gongye Daxue Xuebao/Journal of Harbin Institute of Technology, 2021, 53 (08): : 29 - 38
  • [3] Network Slice Reconfiguration by Exploiting Deep Reinforcement Learning With Large Action Space
    Wei, Fengsheng
    Feng, Gang
    Sun, Yao
    Wang, Yatong
    Qin, Shuang
    Liang, Ying-Chang
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2020, 17 (04): : 2197 - 2211
  • [4] Fast Reconfiguration of Distribution Network Based on Deep Reinforcement Learning Algorithm
    Zhao, Bincheng
    Han, Xueshan
    Ma, Yiran
    Li, Zhiqi
    2020 5TH INTERNATIONAL CONFERENCE ON MATERIALS SCIENCE, ENERGY TECHNOLOGY AND ENVIRONMENTAL ENGINEERING, 2020, 571
  • [5] Query-based Targeted Action-Space Adversarial Policies on Deep Reinforcement Learning Agents
    Lee, Xian Yeow
    Esfandiari, Yasaman
    Tan, Kai Liang
    Sarkar, Soumik
    ICCPS'21: PROCEEDINGS OF THE 2021 ACM/IEEE 12TH INTERNATIONAL CONFERENCE ON CYBER-PHYSICAL SYSTEMS (WITH CPS-IOT WEEK 2021), 2021, : 87 - 97
  • [6] Distribution Network Reconfiguration to Minimize Power Loss Using Deep Reinforcement Learning
    Lim, Se-Heon
    Kim, Tae-Geun
    Yoon, Sung-Guk
    Yoon, Sung-Guk (sgyoon@ssu.ac.kr); Kim, Tae-Geun (taegeun1520@gmail.com), 1659, Korean Institute of Electrical Engineers (69): : 1659 - 1667
  • [7] Distribution Network Reconfiguration Using Deep Reinforcement Learning
    Gautam, Mukesh
    Benidris, Mohammed
    2022 17TH INTERNATIONAL CONFERENCE ON PROBABILISTIC METHODS APPLIED TO POWER SYSTEMS (PMAPS), 2022,
  • [8] Self-healing radial distribution network reconfiguration based on deep reinforcement learning
    Jo, Seungchan
    Oh, Jae-Young
    Yoon, Yong Tae
    Jin, Young Gyu
    RESULTS IN ENGINEERING, 2024, 22
  • [9] Deep Reinforcement Learning Based Approach for Dynamic Optimal Power Flow in Active Distribution Network
    Liu, Xinghua
    Fan, Bangji
    Tian, Jiaqiang
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 1951 - 1956
  • [10] Solving dynamic distribution network reconfiguration using deep reinforcement learning
    Kundacina, Ognjen B.
    Vidovic, Predrag M.
    Petkovic, Milan R.
    ELECTRICAL ENGINEERING, 2022, 104 (03) : 1487 - 1501