Cooperative optimal scheduling strategy of source and storage in microgrid based on soft actor-critic

被引:0
|
作者
Liu L. [1 ]
Zhu J. [1 ]
Chen J. [1 ]
Ye H. [1 ]
机构
[1] School of Electric Power, South China University of Technology, Guangzhou
基金
中国国家自然科学基金;
关键词
Deep learning; Distributionally robust optimizationKey words:microgrid; Energy storage; Generation and transmission system; Optimization and planning; Reinforcement learning; Renewable energy; Robust optimization; Security constraint; Soft actor-critic; Uncertainty;
D O I
10.16081/j.epae.202110036
中图分类号
学科分类号
摘要
In recent years, the proportion of renewable energy and energy storage in microgrid is increasing, which brings new challenges to its optimal scheduling. Aiming at the difficulty in solving the cooperative optimal scheduling problem of source and storage in microgrid due to the non-convex nonlinear constraints, the deep reinforcement learning algorithm is used to construct the data-based strategy function, and the optimal strategy is found out through continuous interactive learning with the environment, so that avoiding the direct solution of the original non-convex nonlinear problem. Considering the strategy function may not meet the security constraints in the training process, furthermore, a learning method of cooperative optimal scheduling secure strategy of source and storage in microgrid based on partial model information is proposed, and the optimal strategy meeting the network security constraints is obtained. In addition, aiming at the problem of long time-consuming due to the interaction between agents and environment in the training process for reinforcement learning, the neural network is used to model the environment, so as to improve the learning efficiency.Review and prospect of robust optimization and planning research on generation and transmission systemYUAN Yang1, ZHANG Heng1, CHENG Haozhong1, LIU Lu1, ZHANG Xiaohu2, LI Gang2, ZHANG Jianping2(1. Key Laboratory Control of Power Transmission and Conversion, Ministry of Education, Shanghai Jiao Tong University, Shanghai 200240, China;2. East China Branch of State Grid Corporation of China, Shanghai 200120, China)With the uncertainty of power system increasing gradually, the application of robust optimization and planning research on generation and transmission system to resist the uncertainty of extremely scenes has become a significant research method. Firstly, the robust optimization is divided into classical robust optimization and distributionally robust optimization from the perspective of whether the probability distribution characteristics of uncertain factors are considered, the mathematical models and uncertain set characteristics of these two kinds of robust optimization are sorted out. Secondly, the existing classical robust optimization and distributionally robust optimization research on generation and transmission system are divided into three aspects:considering the uncertainty of node injection power, considering the uncertainty of power capacity growth and cost, and considering the uncertainty of transmission network state, and the research framework and limitations of robust optimization planning research on generation and transmission system are refined. Finally, the problems worthy of further study in robust optimization planning on power generation and transmission system are prospected, which provides ideas and directions for the robust optimization planning follow-up research on power generation and transmission system. © 2022, Electric Power Automation Equipment Press. All right reserved.
引用
收藏
页码:79 / 85
页数:6
相关论文
共 19 条
  • [1] LUO Zhao, LU Tao, MA Rui, Et al., Optimal scheduling of multi-park integrated energy system under renewable portfolio standard, Electric Power Automation Equipment, 41, 4, pp. 8-14, (2021)
  • [2] YANG Jian, TANG Fei, LIAO Qingfen, Et al., Optimal strategy for coordinating economy and stability of microgrid conside-ring the randomness of renewable energy, Electric Power Automation Equipment, 37, 8, pp. 179-184, (2017)
  • [3] CHEN Lili, MOU Longhua, XU Xufeng, Et al., Influence of ope-ration strategy and operation characteristics of energy storage device on reliability of microgrid, Electric Power Automation Equipment, 37, 7, pp. 70-76, (2017)
  • [4] XIA Chaoying, MIAO Haili, A real-time source storage coope-rative scheduling strategy for microgrid based on quadratic optimal control, Proceedings of the CSEE, 39, 3, pp. 721-730, (2019)
  • [5] LIU Yixin, GUO Li, WANG Chengshan, Two-stage robust optimal economic scheduling method for microgrid, Proceedings of the CSEE, 38, 14, pp. 4013-4022, (2018)
  • [6] HUANG Zhanghao, ZHANG Yachao, ZHENG Feng, Et al., Day-ahead and real-time energy management for active distribution network based on coordinated optimization of different stakeholders, Power System Technology, 45, 6, pp. 2299-2308, (2021)
  • [7] WANG Hao, AI Qian, WU Junhong, Et al., Multi-level distribu-ted scheduling method for micro-grid group based on alternate direction multiplier, Power System Technology, 42, 6, pp. 1718-1727, (2018)
  • [8] CAO T, SHEN Z, ZHANG G., LSTM-aided reinforcement lear-ning for energy management in microgrid with energy storage and EV charging, 15th International Conference on Mobile Ad-Hoc and Sensor Networks(MSN), pp. 13-18, (2020)
  • [9] WEI Y, ZHANG Z, YU F R, Et al., Power allocation in het-nets with hybrid energy supply using actor-critic reinforce-ment learning, Globecom IEEE Global Communications Conference, pp. 1-5, (2017)
  • [10] ODONKOR P, LEWIS K., Control of shared energy storage assets within building clusters using reinforcement learning, International Design Engineering Technical Conferences, pp. 86-94, (2018)