A Generalized Deep Reinforcement Learning Model for Distribution Network Reconfiguration with Power Flow-Based Action-Space Sampling

被引:0
|
作者
Gholizadeh, Nastaran [1 ]
Musilek, Petr [1 ]
机构
[1] Univ Alberta, Elect & Comp Engn, Edmonton, AB T6G 1H9, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
data-driven control; deep reinforcement learning; distribution network reconfiguration; deep Q-learning; dueling deep Q-learning; DYNAMIC RECONFIGURATION; DISTRIBUTION-SYSTEMS; DATA-DRIVEN; OPTIMIZATION; ENHANCEMENT; DG;
D O I
10.3390/en17205187
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Distribution network reconfiguration (DNR) is used by utilities to enhance power system performance in various ways, such as reducing line losses. Conventional DNR algorithms rely on accurate values of network parameters and lack scalability and optimality. To tackle these issues, a new data-driven algorithm based on reinforcement learning is developed for DNR in this paper. The proposed algorithm comprises two main parts. The first part, named action-space sampling, aims at analyzing the network structure, finding all feasible reconfiguration actions, and reducing the size of the action space to only the most optimal actions. In the second part, deep Q-learning (DQN) and dueling DQN methods are used to train an agent to take the best switching actions according to the switch states and loads of the system. The results show that both DQN and dueling DQN are effective in reducing system losses through grid reconfiguration. The proposed methods have faster execution time compared to the conventional methods and are more scalable.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] Flow-based Service Time optimization in software-defined networks using Deep Reinforcement Learning
    Jimenez-Lazaro, Manuel
    Berrocal, Javier
    Galan-Jimenez, Jaime
    COMPUTER COMMUNICATIONS, 2024, 216 : 54 - 67
  • [42] Probabilistic Power Flow of Distribution System Based on a Graph-Aware Deep Learning Network
    Wu, Huayi
    Wang, Minghao
    Xu, Zhao
    Jia, Youwei
    2021 IEEE IAS INDUSTRIAL AND COMMERCIAL POWER SYSTEM ASIA (IEEE I&CPS ASIA 2021), 2021, : 105 - 109
  • [43] A Network Reconfiguration Method for Three-phase Distribution Network using Simplified Power Flow Model
    Wu, Yue
    Wang, Jiarui
    Li, Dexin
    2018 INTERNATIONAL CONFERENCE ON POWER SYSTEM TECHNOLOGY (POWERCON), 2018, : 1573 - 1578
  • [44] Network architecture and action space analysis for deep reinforcement learning towards spacecraft autonomous guidance
    Capra, Lorenzo
    Brandonisio, Andrea
    Lavagna, Michele
    ADVANCES IN SPACE RESEARCH, 2023, 71 (09) : 3787 - 3802
  • [45] Deep reinforcement learning based multi-level dynamic reconfiguration for urban distribution network: a cloud-edge collaboration architecture
    Jiang, Siyuan
    Gao, Hongjun
    Wang, Xiaohui
    Liu, Junyong
    Zuo, Kunyu
    GLOBAL ENERGY INTERCONNECTION-CHINA, 2023, 6 (01): : 1 - 14
  • [46] Deep reinforcement learning based multi-level dynamic reconfiguration for urban distribution network:a cloud-edge collaboration architecture
    Siyuan Jiang
    Hongjun Gao
    Xiaohui Wang
    Junyong Liu
    Kunyu Zuo
    Global Energy Interconnection, 2023, 6 (01) : 1 - 14
  • [47] Multi-timescale Deep Reinforcement Learning for Reactive Power Optimization of Distribution Network
    Hu D.
    Peng Y.
    Wei W.
    Xiao T.
    Cai T.
    Xi W.
    Zhongguo Dianji Gongcheng Xuebao/Proceedings of the Chinese Society of Electrical Engineering, 2022, 42 (14): : 5034 - 5044
  • [48] Deep Reinforcement Learning-Based Power Distribution Network Design Optimization for Multi-Chiplet System
    Miao, Weiyang
    Xie, Zhen
    Tan, Chuan Seng
    Rotaru, Mihai D.
    PROCEEDINGS OF THE IEEE 74TH ELECTRONIC COMPONENTS AND TECHNOLOGY CONFERENCE, ECTC 2024, 2024, : 1716 - 1723
  • [49] Multi-time-scale Online Optimization for Reactive Power of Distribution Network Based on Deep Reinforcement Learning
    Ni S.
    Cui C.
    Yang N.
    Chen H.
    Xi P.
    Li Z.
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2021, 45 (10): : 77 - 85
  • [50] Optimization of oxygen system scheduling in hybrid action space based on deep reinforcement learning
    Li, Lijuan
    Yang, Xue
    Yang, Shipin
    Xu, Xiaowei
    COMPUTERS & CHEMICAL ENGINEERING, 2023, 171