Load balancing and topology dynamic adjustment strategy for power information system network: a deep reinforcement learning-based approach

被引:0
|
作者
Liao, Xiao [1 ]
Bao, Beifang [1 ]
Cui, Wei [1 ]
Liu, Di [1 ]
机构
[1] State Grid Informat & Telecommun Grp Co Ltd, Beijing, Peoples R China
关键词
power information systems; load balancing; flood attack; Markov decision process; deep reinforcement learning;
D O I
10.3389/fenrg.2023.1342854
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
As power information systems play an increasingly critical role in modern society, higher requirements are placed on the performance and reliability of their network infrastructure. In order to cope with the growing data traffic and network attack threats in the power information system, we select the power information system data center network as the research object and design an overall system solution based on software defined network, including the application layer, control layer and infrastructure layer. A typical fat tree network topology is simulated and analyzed. We define the load balancing and network topology dynamic adjustment problem as a Markov decision process, and design a data flow path acquisition method based on breadth-first search to construct the action space of each host. Then, a deep reinforcement learning algorithm based on deep Q-network, priority experience replay and target network is introduced to provide solutions for optimizing the performance of power information systems and responding to network attacks. Simulation results show that the proposed method is better than the traditional equal-cost multi-path algorithm in terms of average bandwidth utilization, average jitter and average packet loss, and can reduce the probability of network nodes being attacked by more than 11%.
引用
收藏
页数:12
相关论文
共 50 条
  • [11] Deep Reinforcement Learning-based CIO and Energy Control for LTE Mobility Load Balancing
    Alsuhli, Ghada
    Ismail, Hassan A.
    Alansary, Kareem
    Rumman, Mahmoud
    Mohamed, Mostafa
    Seddik, Karim G.
    2021 IEEE 18TH ANNUAL CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE (CCNC), 2021,
  • [12] Deep Reinforcement Learning-Based Task Offloading and Load Balancing for Vehicular Edge Computing
    Wu, Zhoupeng
    Jia, Zongpu
    Pang, Xiaoyan
    Zhao, Shan
    ELECTRONICS, 2024, 13 (08)
  • [13] Deep Reinforcement Learning-Based Approach for Autonomous Power Flow Control Using Only Topology Changes
    Damjanovic, Ivana
    Pavic, Ivica
    Puljiz, Mate
    Brcic, Mario
    ENERGIES, 2022, 15 (19)
  • [14] A reinforcement learning-based load balancing algorithm for fog computing
    Niloofar Tahmasebi-Pouya
    Mehdi Agha Sarram
    Seyedakbar Mostafavi
    Telecommunication Systems, 2023, 84 : 321 - 339
  • [15] A reinforcement learning-based load balancing algorithm for fog computing
    Tahmasebi-Pouya, Niloofar
    Sarram, Mehdi Agha
    Mostafavi, Seyedakbar
    TELECOMMUNICATION SYSTEMS, 2023, 84 (03) : 321 - 339
  • [16] Power Network Topology Optimization and Power Flow Control Based on Deep Reinforcement Learning
    Zhou Y.
    Zhou L.
    Ding J.
    Gao J.
    Shanghai Jiaotong Daxue Xuebao/Journal of Shanghai Jiaotong University, 2021, 55 : 7 - 14
  • [17] Deep Reinforcement Learning-Based Tie-Line Power Adjustment Method for Power System Operation State Calculation
    Xu, Huating
    Yu, Zhihong
    Zheng, Qingping
    Hou, Jinxiu
    Wei, Yawei
    Zhang, Zhijian
    IEEE ACCESS, 2019, 7 : 156160 - 156174
  • [18] Deep Reinforcement Learning based Load Balancing Policy for balancing network traffic in datacenter environment.
    Doke, Ashwini R.
    Sangeeta, K.
    PROCEEDINGS OF THE SECOND INTERNATIONAL CONFERENCE ON GREEN COMPUTING AND INTERNET OF THINGS (ICGCIOT 2018), 2018, : 1 - 5
  • [19] Deep reinforcement learning-based balancing and sequencing approach for mixed model assembly lines
    Lv Youlong
    Tan Yuanliang
    Ray, Zhong
    Zhang Peng
    Wang Junliang
    Zhang Jie
    IET COLLABORATIVE INTELLIGENT MANUFACTURING, 2022, 4 (03) : 181 - 193
  • [20] Reinforcement Learning-Based Near-Optimal Load Balancing for Heterogeneous LiFi WiFi Network
    Ahmad, Rizwana
    Soltani, Mohammad Dehghani
    Safari, Majid
    Srivastava, Anand
    IEEE SYSTEMS JOURNAL, 2022, 16 (02): : 3084 - 3095