Load balancing and topology dynamic adjustment strategy for power information system network: a deep reinforcement learning-based approach

被引:0
|
作者
Liao, Xiao [1 ]
Bao, Beifang [1 ]
Cui, Wei [1 ]
Liu, Di [1 ]
机构
[1] State Grid Informat & Telecommun Grp Co Ltd, Beijing, Peoples R China
关键词
power information systems; load balancing; flood attack; Markov decision process; deep reinforcement learning;
D O I
10.3389/fenrg.2023.1342854
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
As power information systems play an increasingly critical role in modern society, higher requirements are placed on the performance and reliability of their network infrastructure. In order to cope with the growing data traffic and network attack threats in the power information system, we select the power information system data center network as the research object and design an overall system solution based on software defined network, including the application layer, control layer and infrastructure layer. A typical fat tree network topology is simulated and analyzed. We define the load balancing and network topology dynamic adjustment problem as a Markov decision process, and design a data flow path acquisition method based on breadth-first search to construct the action space of each host. Then, a deep reinforcement learning algorithm based on deep Q-network, priority experience replay and target network is introduced to provide solutions for optimizing the performance of power information systems and responding to network attacks. Simulation results show that the proposed method is better than the traditional equal-cost multi-path algorithm in terms of average bandwidth utilization, average jitter and average packet loss, and can reduce the probability of network nodes being attacked by more than 11%.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Deep Reinforcement Learning-Based Trading Strategy for Load Aggregators on Price-Responsive Demand
    Yang, Guang
    Du, Songhuai
    Duan, Qingling
    Su, Juan
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [32] Deep Reinforcement Learning Based Load Control Strategy for Combined Heat and Power Units
    Xie, Ge
    Cui, Chenggang
    Zhao, Huirong
    Yang, Jiguang
    Shi, Yunfei
    2021 11TH INTERNATIONAL CONFERENCE ON POWER AND ENERGY SYSTEMS (ICPES 2021), 2021, : 280 - 284
  • [33] A Deep Reinforcement Learning-Based Approach in Porker Game
    Kong, Yan
    Rui, Yefeng
    Hsia, Chih-Hsien
    Journal of Computers (Taiwan), 2023, 34 (02) : 41 - 51
  • [34] Computing on Wheels: A Deep Reinforcement Learning-Based Approach
    Kazmi, S. M. Ahsan
    Tai Manh Ho
    Tuong Tri Nguyen
    Fahim, Muhammad
    Khan, Adil
    Piran, Md Jalil
    Baye, Gaspard
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) : 22535 - 22548
  • [35] A Deep Reinforcement Learning Based Framework for Power System Load Frequency Control
    Zhang, Guanyu
    Teng, Mengjie
    Chen, Chen
    Bie, Zhaohong
    2022 IEEE/IAS INDUSTRIAL AND COMMERCIAL POWER SYSTEM ASIA (I&CPS ASIA 2022), 2022, : 1801 - 1805
  • [36] Deep reinforcement learning-based moving target defense method in computing power network
    Zhang T.
    Xu C.
    Lian Y.
    Kang J.
    Kuang X.
    Scientia Sinica Informationis, 2023, 53 (12) : 2372 - 2385
  • [37] A Deep Reinforcement Learning-Based Caching Strategy for Internet of Things
    Nasehzadeh, Ali
    Wang, Ping
    2020 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2020, : 969 - 974
  • [38] A Dynamic Internal Trading Price Strategy for Networked Microgrids: A Deep Reinforcement Learning-Based Game-Theoretic Approach
    Van-Hai Bui
    Hussain, Akhtar
    Su, Wencong
    IEEE TRANSACTIONS ON SMART GRID, 2022, 13 (05) : 3408 - 3421
  • [39] Deep reinforcement learning-based network for optimized power flow in islanded DC microgrid
    Jeyaraj, Pandia Rajan
    Asokan, Siva Prakash
    Kathiresan, Aravind Chellachi
    Nadar, Edward Rajan Samuel
    ELECTRICAL ENGINEERING, 2023, 105 (5) : 2805 - 2816
  • [40] Deep reinforcement learning-based network for optimized power flow in islanded DC microgrid
    Pandia Rajan Jeyaraj
    Siva Prakash Asokan
    Aravind Chellachi Kathiresan
    Edward Rajan Samuel Nadar
    Electrical Engineering, 2023, 105 : 2805 - 2816