Predictive Control of Voltage Source Inverter: An Online Reinforcement Learning Solution

被引:30
|
作者
Liu, Xing [1 ,2 ]
Qiu, Lin [2 ]
Fang, Youtong [2 ]
Wang, Kui [3 ]
Li, Yongdong [3 ]
Rodriguez, Jose [4 ]
机构
[1] Shanghai Dianji Univ, Coll Elect Engn, Shanghai 201306, Peoples R China
[2] Zhejiang Univ, Coll Elect Engn, Hangzhou 310027, Peoples R China
[3] Tsinghua Univ, Dept Elect Engn, State Key Lab Power Syst, Beijing 100084, Peoples R China
[4] Univ San Sebastian Santiago, Fac Engn, Santiago 8420524, Chile
基金
国家重点研发计划;
关键词
Finite control-set model predictive control (FCS-MPC); neural network (NN); power converters; reinforcement learning (RL); CONVERTERS; MPC;
D O I
10.1109/TIE.2023.3303626
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The focus of this article is to introduce the concept of an online reinforcement learning (RL) solution and to propose a novel finite control-set model predictive control framework subject to system uncertainties, which possesses the excellent applicative potential for power converter systems with unknown perturbations. In this framework, the control task is performed by incorporating an adaptive neural network approximation-based RL and neural predictor-based predictive current control solution. To be more precise, a critic neural network is responsible for learning a strategic utility function online, and an actor network is developed to derive control behaviors by approximating the unknown model dynamics and optimizing the learned utility function obtained from the critic network. Compared to previous works, it not only attenuates the inherent issues of system uncertainties and unknown disturbances, but also provides a flexible framework and allows the enhancement of control property. Furthermore, by deploying the Lyapunov approach, it shows that all signals in the closed-loop system are uniformly ultimately bounded. Finally, numerical simulation and experiments validate our theoretical findings.
引用
收藏
页码:6591 / 6600
页数:10
相关论文
共 50 条
  • [41] aVsIs: An Analytical-Solution-Based Solver for Model-Predictive Control With Hexagonal Constraints in Voltage-Source Inverter Applications
    De Martin, Ismaele Diego
    Pasqualotto, Dario
    Tinazzi, Fabio
    IEEE TRANSACTIONS ON POWER ELECTRONICS, 2022, 37 (12) : 14375 - 14383
  • [42] The Conversion Algorithm of Voltage Source Inverter Control Signals for Operating Current Source Inverter
    Volkov, Alexander G.
    Makarov, Denis V.
    Zharkov, Maksim A.
    Balagurov, Maxim V.
    2015 16TH INTERNATIONAL CONFERENCE OF YOUNG SPECIALISTS ON MICRO/NANOTECHNOLOGIES AND ELECTRON DEVICES, 2015, : 402 - 406
  • [43] Graph Multi-Agent Reinforcement Learning for Inverter-Based Active Voltage Control
    Mu, Chaoxu
    Liu, Zhaoyang
    Yan, Jun
    Jia, Hongjie
    Zhang, Xiaoyu
    IEEE TRANSACTIONS ON SMART GRID, 2024, 15 (02) : 1399 - 1409
  • [44] A Model Predictive Control-Based Common-Mode Voltage Suppression Strategy for Voltage-Source Inverter
    Guo, Leilei
    Zhang, Xing
    Yang, Shuying
    Xie, Zhen
    Cao, Renxian
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2016, 63 (10) : 6115 - 6125
  • [45] Optimal Voltage Vector Sequences on Model Predictive Control for a Grid Connected Three-Phase Voltage Source Inverter
    Dowruang, Supee
    Theeranan, Jessada
    Bumrungsri, Pornchai
    Jeraputra, Chuttchaval
    2016 13TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING/ELECTRONICS, COMPUTER, TELECOMMUNICATIONS AND INFORMATION TECHNOLOGY (ECTI-CON), 2016,
  • [46] A control strategy of microgrid voltage source inverter based on self-learning sliding mode control
    Zhang, Zunyang
    Li, Xuesheng
    Sun, Ying
    IET POWER ELECTRONICS, 2023, 16 (12) : 1958 - 1968
  • [47] A source voltage-clamped resonant link inverter for a PMSM using a predictive current control technique
    Oh, IH
    Jung, YS
    Youn, MJ
    IEEE TRANSACTIONS ON POWER ELECTRONICS, 1999, 14 (06) : 1122 - 1132
  • [48] FPGA implementation and analysis of model predictive current control for three-phase voltage source inverter
    Rameshkumar K.
    Indragandhi V.
    Sakthivel A.
    Palanisamy K.
    International Journal of Power Electronics, 2018, 9 (01) : 29 - 51
  • [49] Source voltage-clamped resonant link inverter for a PMSM using a predictive current control technique
    Fairchild Korea Semiconductor Ltd, Puchon City, Korea, Republic of
    IEEE Trans Power Electron, 6 (1122-1132):
  • [50] Grid Connected Voltage Source Inverter Control During Voltage Dips
    Gabe, Ivan J.
    Kuenzel Palha, Fabio F.
    Pinheiro, Humberto
    IECON: 2009 35TH ANNUAL CONFERENCE OF IEEE INDUSTRIAL ELECTRONICS, VOLS 1-6, 2009, : 4346 - +