Online Constraint Tightening in Stochastic Model Predictive Control: A Regression Approach

被引:0
|
作者
Capone, Alexandre [1 ]
Brudigam, Tim [2 ]
Hirche, Sandra [3 ]
机构
[1] Carnegie Mellon Univ, Robot Inst, Pittsburgh, PA 15213 USA
[2] Tech Univ Munich, Chair Automat Control Engn, D-80333 Munich, Germany
[3] Tech Univ Munich, Sch Computat Informat & Technol, D-80333 Munich, Germany
基金
欧洲研究理事会;
关键词
Stochastic processes; Uncertainty; Symbols; Optimal control; Costs; Computational modeling; Closed loop systems; Autonomous systems; data-driven control; Gaussian processes (GPs); machine learning; online learning; optimal control; reinforcement learning; statistical learning; stochastic processes; uncertain systems; CONVERGENCE; STABILITY; ROBUST; RATES;
D O I
10.1109/TAC.2024.3433988
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Solving chance-constrained stochastic optimal control problems is a significant challenge in control. This is because no analytical solutions exist for up to a handful of special cases. A common and computationally efficient approach for tackling chance-constrained stochastic optimal control problems consists of a deterministic reformulation, where hard constraints with an additional constraint-tightening parameter are imposed on a nominal prediction that ignores stochastic disturbances. However, in such approaches, the choice of constraint-tightening parameter remains challenging, and guarantees can mostly be obtained assuming that the process noise distribution is known a priori. Moreover, the chance constraints are often not tightly satisfied, leading to unnecessarily high costs. This work proposes a data-driven approach for learning the constraint-tightening parameters online during control. To this end, we reformulate the choice of constraint-tightening parameter for the closed loop as a binary regression problem. We then leverage a highly expressive Gaussian process, model for binary regression to approximate the smallest constraint-tightening parameters that satisfy the chance constraints. By tuning the algorithm parameters appropriately, we show that the resulting constraint-tightening parameters satisfy the chance constraints up to an arbitrarily small margin with high probability. Our approach yields constraint-tightening parameters that tightly satisfy the chance constraints in numerical experiments, resulting in a lower average cost than three other state-of-the-art approaches.
引用
收藏
页码:736 / 750
页数:15
相关论文
共 50 条
  • [41] Safe Stochastic Model Predictive Control
    Brudigam, T.
    Jacumet, R.
    Wollherr, D.
    Leibold, M.
    2022 IEEE 61ST CONFERENCE ON DECISION AND CONTROL (CDC), 2022, : 1796 - 1802
  • [42] Stochastic Gradient Methods for Stochastic Model Predictive Control
    Themelis, Andreas
    Villa, Silvia
    Patrinos, Panagiotis
    Bemporad, Alberto
    2016 EUROPEAN CONTROL CONFERENCE (ECC), 2016, : 154 - 159
  • [43] The Stochastic Robustness of Nominal and Stochastic Model Predictive Control
    Mcallister, Robert D.
    Rawlings, James B.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (10) : 5810 - 5822
  • [44] A soft constraint approach to Stochastic receding horizon control
    Primbs, James A.
    PROCEEDINGS OF THE 46TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-14, 2007, : 356 - 361
  • [45] Stochastic Model Predictive Control With Minimal Constraint Violation Probability for Time-Variant Chance Constraints
    Fink, Michael
    Wollherr, Dirk
    Leibold, Marion
    IEEE CONTROL SYSTEMS LETTERS, 2024, 8 : 1385 - 1390
  • [46] Dynamic option hedging with transaction costs: A stochastic model predictive control approach
    Plessen, Mogens Graf
    Puglia, Laura
    Gabbriellini, Tommaso
    Bemporad, Alberto
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2019, 29 (15) : 5058 - 5077
  • [47] A probabilistic validation approach for penalty function design in Stochastic Model Predictive Control
    Mammarella, Martina
    Alamo, Teodoro
    Lucia, Sergio
    Dabbene, Fabrizio
    IFAC PAPERSONLINE, 2020, 53 (02): : 11271 - 11276
  • [48] A Stochastic Model Predictive Control Approach to Dynamic Option Hedging with Transaction Costs
    Bemporad, Alberto
    Puglia, Laura
    Gabbriellini, Tommaso
    2011 AMERICAN CONTROL CONFERENCE, 2011, : 3862 - 3867
  • [49] Fast Nonlinear Model Predictive Control Combining Online Trajectory Optimization and Value Function Regression
    Neve, Thomas
    Lefebvre, Tom
    Crevecoeur, Guillaume
    OPTIMAL CONTROL APPLICATIONS & METHODS, 2025, 46 (02): : 709 - 725
  • [50] A zone control strategy for stochastic model predictive control
    Santoro, Bruno F.
    Ferramosca, Antonio
    Gonzalez, Alejandro H.
    Odloak, Darci
    2016 AMERICAN CONTROL CONFERENCE (ACC), 2016, : 5370 - 5375