Load balancing and topology dynamic adjustment strategy for power information system network: a deep reinforcement learning-based approach

被引:0
|
作者
Liao, Xiao [1 ]
Bao, Beifang [1 ]
Cui, Wei [1 ]
Liu, Di [1 ]
机构
[1] State Grid Informat & Telecommun Grp Co Ltd, Beijing, Peoples R China
关键词
power information systems; load balancing; flood attack; Markov decision process; deep reinforcement learning;
D O I
10.3389/fenrg.2023.1342854
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
As power information systems play an increasingly critical role in modern society, higher requirements are placed on the performance and reliability of their network infrastructure. In order to cope with the growing data traffic and network attack threats in the power information system, we select the power information system data center network as the research object and design an overall system solution based on software defined network, including the application layer, control layer and infrastructure layer. A typical fat tree network topology is simulated and analyzed. We define the load balancing and network topology dynamic adjustment problem as a Markov decision process, and design a data flow path acquisition method based on breadth-first search to construct the action space of each host. Then, a deep reinforcement learning algorithm based on deep Q-network, priority experience replay and target network is introduced to provide solutions for optimizing the performance of power information systems and responding to network attacks. Simulation results show that the proposed method is better than the traditional equal-cost multi-path algorithm in terms of average bandwidth utilization, average jitter and average packet loss, and can reduce the probability of network nodes being attacked by more than 11%.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Deep Reinforcement Learning-Based Active Network Management and Emergency Load-Shedding Control for Power Systems
    Zhang, Haotian
    Sun, Xinfeng
    Lee, Myoung Hoon
    Moon, Jun
    IEEE TRANSACTIONS ON SMART GRID, 2024, 15 (02) : 1423 - 1437
  • [22] Deep Reinforcement Learning Based Approach for Dynamic Optimal Power Flow in Active Distribution Network
    Liu, Xinghua
    Fan, Bangji
    Tian, Jiaqiang
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 1951 - 1956
  • [23] Deep Reinforcement Learning-Based Defense Strategy Selection
    Charpentier, Axel
    Boulahia-Cuppens, Nora
    Cuppens, Frederic
    Yaich, Reda
    PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON AVAILABILITY, RELIABILITY AND SECURITY, ARES 2022, 2022,
  • [24] Intelligent Adjustment for Power System Operation Mode Based on Deep Reinforcement Learning
    Hu, Wei
    Mi, Ning
    Wu, Shuang
    Zhang, Huiling
    Hu, Zhewen
    Zhang, Lei
    IENERGY, 2024, 3 (04): : 252 - 260
  • [25] Power System Flow Adjustment and Sample Generation Based on Deep Reinforcement Learning
    Shuang Wu
    Wei Hu
    Zongxiang Lu
    Yujia Gu
    Bei Tian
    Hongqiang Li
    Journal of Modern Power Systems and Clean Energy, 2020, 8 (06) : 1115 - 1127
  • [26] Power System Flow Adjustment and Sample Generation Based on Deep Reinforcement Learning
    Wu, Shuang
    Hu, Wei
    Lu, Zongxiang
    Gu, Yujia
    Tian, Bei
    Li, Hongqiang
    JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2020, 8 (06) : 1115 - 1127
  • [27] Dynamic optimization of an integrated energy system with carbon capture and power-to-gas interconnection: A deep reinforcement learning-based scheduling strategy
    Liang, Tao
    Chai, Lulu
    Tan, Jianxin
    Jing, Yanwei
    Lv, Liangnian
    APPLIED ENERGY, 2024, 367
  • [28] Reinforcement learning-based load balancing for heavy traffic Internet of Things
    Lei, Jianjun
    Liu, Jie
    PERVASIVE AND MOBILE COMPUTING, 2024, 99
  • [29] Deep Reinforcement Learning-Based Power Distribution Network Design Optimization for Multi-Chiplet System
    Miao, Weiyang
    Xie, Zhen
    Tan, Chuan Seng
    Rotaru, Mihai D.
    PROCEEDINGS OF THE IEEE 74TH ELECTRONIC COMPONENTS AND TECHNOLOGY CONFERENCE, ECTC 2024, 2024, : 1716 - 1723
  • [30] Meta learning-based deep reinforcement learning algorithm for task offloading in dynamic vehicular network
    Liu, Liang
    Jing, Tengxiang
    Li, Wenwei
    Duan, Jie
    Mao, Wuping
    Liu, Huan
    Liu, Guanyu
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 143