Multi-Agent Deep Reinforcement Learning for Sectional AGC Dispatch

被引:18
|
作者
Li, Jiawen [1 ]
Yu, Tao [1 ]
Zhu, Hanxin [1 ]
Li, Fusheng [1 ]
Lin, Dan [1 ]
Li, Zhuohuan [1 ]
机构
[1] South China Univ Technol, Coll Elect Power, Guangzhou 510640, Peoples R China
来源
IEEE ACCESS | 2020年 / 8卷
基金
中国国家自然科学基金;
关键词
Automatic generation control; Security; Power grids; Training; Phasor measurement units; Optimization; Voltage measurement; hierarchical multi-agent deep deterministic policy gradient; sectional AGC dispatch; reinforcement learning; AUTOMATIC-GENERATION CONTROL;
D O I
10.1109/ACCESS.2020.3019929
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aiming at the problem of coordinating system economy, security and control performance in secondary frequency regulation of the power grid, a sectional automatic generation control (AGC) dispatch framework is proposed. The dispatch of AGC is classified as three sections with the sectional dispatch method. Besides, a hierarchical multi-agent deep deterministic policy gradient (HMA-DDPG) algorithm is proposed for the framework in this paper. This algorithm, considering economy and security of the system in AGC dispatch, can ensure the control performance of AGC. Furthermore, through simulation, the control effect of the sectional dispatch method and several AGC dispatch methods on the Guangdong province power grid system and the IEEE 39 bus system is compared. The result shows that the best effect can be achieved with the sectional dispatch method.
引用
收藏
页码:158067 / 158081
页数:15
相关论文
共 50 条
  • [41] Bayesian Action Decoder for Deep Multi-Agent Reinforcement Learning
    Foerster, Jakob N.
    Song, H. Francis
    Hughes, Edward
    Burch, Neil
    Dunning, Iain
    Whiteson, Shimon
    Botvinick, Matthew M.
    Bowling, Michael
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [42] Competitive Multi-Agent Deep Reinforcement Learning with Counterfactual Thinking
    Wang, Yue
    Wan, Yao
    Zhang, Chenwei
    Bai, Lu
    Cui, Lixin
    Yu, Philip S.
    2019 19TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2019), 2019, : 1366 - 1371
  • [43] Eavesdropping Game Based on Multi-Agent Deep Reinforcement Learning
    Guo, Delin
    Tang, Lan
    Yang, Lvxi
    Liang, Ying-Chang
    IEEE Workshop on Signal Processing Advances in Wireless Communications, SPAWC, 2022, 2022-July
  • [44] Cooperative Multi-Agent Deep Reinforcement Learning in Soccer Domains
    Ocana, Jim Martin Catacora
    Riccio, Francesco
    Capobianco, Roberto
    Nardi, Daniele
    AAMAS '19: PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS, 2019, : 1865 - 1867
  • [45] Important Scientific Problems of Multi-Agent Deep Reinforcement Learning
    Sun C.-Y.
    Mu C.-X.
    Zidonghua Xuebao/Acta Automatica Sinica, 2020, 46 (07): : 1301 - 1312
  • [46] Transform networks for cooperative multi-agent deep reinforcement learning
    Wang, Hongbin
    Xie, Xiaodong
    Zhou, Lianke
    APPLIED INTELLIGENCE, 2023, 53 (08) : 9261 - 9269
  • [47] Eavesdropping Game Based on Multi-Agent Deep Reinforcement Learning
    Guo, Delin
    Tang, Lan
    Yang, Lvxi
    Liang, Ying-Chang
    2022 IEEE 23RD INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATION (SPAWC), 2022,
  • [48] Survey of Fully Cooperative Multi-Agent Deep Reinforcement Learning
    Zhao, Liyang
    Chang, Tianqing
    Chu, Kaixuan
    Guo, Libin
    Zhang, Lei
    Computer Engineering and Applications, 2023, 59 (12) : 14 - 27
  • [49] Multi-agent deep reinforcement learning strategy for distributed energy
    Xi, Lei
    Sun, Mengmeng
    Zhou, Huan
    Xu, Yanchun
    Wu, Junnan
    Li, Yanying
    MEASUREMENT, 2021, 185
  • [50] Autonomous Separation Assurance with Deep Multi-Agent Reinforcement Learning
    Brittain, Marc W.
    Yang, Xuxi
    Wei, Peng
    JOURNAL OF AEROSPACE INFORMATION SYSTEMS, 2021, 18 (12): : 890 - 905