Online Constraint Tightening in Stochastic Model Predictive Control: A Regression Approach

被引:0
|
作者
Capone, Alexandre [1 ]
Brudigam, Tim [2 ]
Hirche, Sandra [3 ]
机构
[1] Carnegie Mellon Univ, Robot Inst, Pittsburgh, PA 15213 USA
[2] Tech Univ Munich, Chair Automat Control Engn, D-80333 Munich, Germany
[3] Tech Univ Munich, Sch Computat Informat & Technol, D-80333 Munich, Germany
基金
欧洲研究理事会;
关键词
Stochastic processes; Uncertainty; Symbols; Optimal control; Costs; Computational modeling; Closed loop systems; Autonomous systems; data-driven control; Gaussian processes (GPs); machine learning; online learning; optimal control; reinforcement learning; statistical learning; stochastic processes; uncertain systems; CONVERGENCE; STABILITY; ROBUST; RATES;
D O I
10.1109/TAC.2024.3433988
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Solving chance-constrained stochastic optimal control problems is a significant challenge in control. This is because no analytical solutions exist for up to a handful of special cases. A common and computationally efficient approach for tackling chance-constrained stochastic optimal control problems consists of a deterministic reformulation, where hard constraints with an additional constraint-tightening parameter are imposed on a nominal prediction that ignores stochastic disturbances. However, in such approaches, the choice of constraint-tightening parameter remains challenging, and guarantees can mostly be obtained assuming that the process noise distribution is known a priori. Moreover, the chance constraints are often not tightly satisfied, leading to unnecessarily high costs. This work proposes a data-driven approach for learning the constraint-tightening parameters online during control. To this end, we reformulate the choice of constraint-tightening parameter for the closed loop as a binary regression problem. We then leverage a highly expressive Gaussian process, model for binary regression to approximate the smallest constraint-tightening parameters that satisfy the chance constraints. By tuning the algorithm parameters appropriately, we show that the resulting constraint-tightening parameters satisfy the chance constraints up to an arbitrarily small margin with high probability. Our approach yields constraint-tightening parameters that tightly satisfy the chance constraints in numerical experiments, resulting in a lower average cost than three other state-of-the-art approaches.
引用
收藏
页码:736 / 750
页数:15
相关论文
共 50 条
  • [31] Stochastic MPC with Realization-Adaptive Constraint Tightening
    Lee, Hotae
    Bujarbaruah, Monimoy
    Borrelli, Francesco
    2023 AMERICAN CONTROL CONFERENCE, ACC, 2023, : 1838 - 1843
  • [32] A stochastic model predictive control approach for modelling human driver steering control
    Qu, Ting
    Chen, Hong
    Ji, Yan
    Guo, Hongyan
    Xu, Yueting
    INTERNATIONAL JOURNAL OF VEHICLE DESIGN, 2016, 70 (03) : 249 - 277
  • [33] Stability of Progressively Tightening Model Predictive Control in Continuous Time
    Baumgaertner, Katrin
    Diehl, Moritz
    IFAC PAPERSONLINE, 2024, 58 (18): : 349 - 355
  • [34] On the Unrestricted Horizon Predictive Control - a fully stochastic model-based predictive approach
    Trentini, Rodrigo
    Silveira, Antonio
    Kutzner, Ruediger
    Hofmann, Lutz
    2016 EUROPEAN CONTROL CONFERENCE (ECC), 2016, : 1322 - 1327
  • [35] A Computational Approach to Explicit Feedback Stochastic Nonlinear Model Predictive Control
    Grancharova, Alexandra
    Johansen, Tor A.
    49TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2010, : 6083 - 6088
  • [36] Model predictive control with active learning for stochastic systems with structural model uncertainty: Online model discrimination
    Heirung, Tor Aksel N.
    Santos, Tito L. M.
    Mesbah, Ali
    COMPUTERS & CHEMICAL ENGINEERING, 2019, 128 : 128 - 140
  • [37] Stochastic Model Predictive Control Approach to Autonomous Vehicle Lane Keeping
    Zhang C.
    Zhuang C.
    Zheng X.
    Cai R.
    Li M.
    Journal of Shanghai Jiaotong University (Science), 2021, 26 (05) : 626 - 633
  • [38] An Approximate Dynamic Programming Approach for Dual Stochastic Model Predictive Control
    Arcari, Elena
    Hewing, Lukas
    Zeilinger, Melanie N.
    IFAC PAPERSONLINE, 2020, 53 (02): : 8105 - 8111
  • [39] Adaptive stochastic model predictive control of linear systems using Gaussian process regression
    Li, Fei
    Li, Huiping
    He, Yuyao
    IET CONTROL THEORY AND APPLICATIONS, 2021, 15 (05): : 683 - 693
  • [40] Online Learning for Safe Model Predictive Control with the Compatible Models Approach
    Makdesi, Anas
    Girard, Antoine
    Fribourg, Laurent
    IFAC PAPERSONLINE, 2024, 58 (11): : 147 - 152