A Generalized Deep Reinforcement Learning Model for Distribution Network Reconfiguration with Power Flow-Based Action-Space Sampling

被引:0
|
作者
Gholizadeh, Nastaran [1 ]
Musilek, Petr [1 ]
机构
[1] Univ Alberta, Elect & Comp Engn, Edmonton, AB T6G 1H9, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
data-driven control; deep reinforcement learning; distribution network reconfiguration; deep Q-learning; dueling deep Q-learning; DYNAMIC RECONFIGURATION; DISTRIBUTION-SYSTEMS; DATA-DRIVEN; OPTIMIZATION; ENHANCEMENT; DG;
D O I
10.3390/en17205187
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Distribution network reconfiguration (DNR) is used by utilities to enhance power system performance in various ways, such as reducing line losses. Conventional DNR algorithms rely on accurate values of network parameters and lack scalability and optimality. To tackle these issues, a new data-driven algorithm based on reinforcement learning is developed for DNR in this paper. The proposed algorithm comprises two main parts. The first part, named action-space sampling, aims at analyzing the network structure, finding all feasible reconfiguration actions, and reducing the size of the action space to only the most optimal actions. In the second part, deep Q-learning (DQN) and dueling DQN methods are used to train an agent to take the best switching actions according to the switch states and loads of the system. The results show that both DQN and dueling DQN are effective in reducing system losses through grid reconfiguration. The proposed methods have faster execution time compared to the conventional methods and are more scalable.
引用
收藏
页数:18
相关论文
共 50 条
  • [31] Reinforcement Learning-based Smart Inverter Control with Polar Action Space in Power Distribution Systems
    Kabir, Farzana
    Gao, Yuanqi
    Yu, Nanpeng
    5TH IEEE CONFERENCE ON CONTROL TECHNOLOGY AND APPLICATIONS (IEEE CCTA 2021), 2021, : 315 - 322
  • [32] Multi-Objective Distribution Network Reconfiguration Based on Deep Learning Algorithm
    Chen Xingang
    Tan Hao
    Yu Bing
    Li Changxin
    Chen Xiaoqing
    2018 IEEE INTERNATIONAL CONFERENCE ON HIGH VOLTAGE ENGINEERING AND APPLICATION (ICHVE), 2018,
  • [33] Many-Objective Distribution Network Reconfiguration Via Deep Reinforcement Learning Assisted Optimization Algorithm
    Li, Yuanzheng
    Hao, Guokai
    Liu, Yun
    Yu, Yaowen
    Ni, Zhixian
    Zhao, Yong
    IEEE TRANSACTIONS ON POWER DELIVERY, 2022, 37 (03) : 2230 - 2244
  • [34] Continuous Reactive Power Optimization of Distribution Network Using Deep Reinforcement Learning
    Li Q.
    Qiao Y.
    Zhang Y.
    Dianwang Jishu/Power System Technology, 2020, 44 (04): : 1473 - 1480
  • [35] Power distribution network reconfiguration based on min-cost flow problem
    Zazou, Abdelkrim Ali
    Grolleau, Emmanuel
    Chevrier, Emilie
    Richard, Pascal
    Gaubert, Jean-Paul
    Bellatreche, Ladjel
    2016 IEEE 14TH INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS (INDIN), 2016, : 286 - 291
  • [36] QoS-aware data center network reconfiguration method based on deep reinforcement learning
    Guo, Xiaotao
    Yan, Fulong
    Xue, Xuwei
    Pan, Bitao
    Exarchakos, George
    Calabretta, Nicola
    JOURNAL OF OPTICAL COMMUNICATIONS AND NETWORKING, 2021, 13 (05) : 94 - 107
  • [37] Voltage Optimal Control of Distribution Network Based on Deep Reinforcement Learning
    Quan H.
    Peng X.
    Liu H.
    Zhou P.
    Wu Z.
    Su H.
    Dianwang Jishu/Power System Technology, 2023, 47 (05): : 2029 - 2038
  • [38] Reactive Power Flow Convergence Adjustment Based on Deep Reinforcement Learning
    Zhang W.
    Ji B.
    He P.
    Wang N.
    Wang Y.
    Zhang M.
    Energy Engineering: Journal of the Association of Energy Engineering, 2023, 120 (09): : 2177 - 2192
  • [39] Online reconfiguration scheme of self-sufficient distribution network based on a reinforcement learning approach
    Oh, Seok Hwa
    Yoon, Yong Tae
    Kim, Seung Wan
    APPLIED ENERGY, 2020, 280
  • [40] REDO-SLAM: Robust Efficient Dynamic Optical Flow-based SLAM with Deep Reinforcement Learning
    Taghavi, Samira
    Razavi, Abbas Kafaee
    Fotouhi, Farshad
    2024 18TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION, ICARCV, 2024, : 1086 - 1093