The Power of Predictions in Online Control

被引:0
|
作者
Yu, Chenkai [1 ]
Shi, Guanya [2 ]
Chung, Soon-Jo [3 ]
Yue, Yisong [2 ]
Wierman, Adam [2 ]
机构
[1] Tsinghua Univ, IIIS, Beijing, Peoples R China
[2] CALTECH, CMS, Pasadena, CA USA
[3] CALTECH, CMS, GALCIT, JPL, Pasadena, CA USA
关键词
STABILITY;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We study the impact of predictions in online Linear Quadratic Regulator control with both stochastic and adversarial disturbances in the dynamics. In both settings, we characterize the optimal policy and derive tight bounds on the minimum cost and dynamic regret. Perhaps surprisingly, our analysis shows that the conventional greedy MPC approach is a near-optimal policy in both stochastic and adversarial settings. Specifically, for length-T problems, MPC requires only O(log T) predictions to reach O(1) dynamic regret, which matches (up to lower-order terms) our lower bound on the required prediction horizon for constant regret.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Online Metric Algorithms with Untrusted Predictions
    Antoniadis, Antonios
    Coester, Christian
    Elias, Marek
    Polak, Adam
    Simon, Bertrand
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [32] Customizing ML Predictions For Online Algorithms
    Anand, Keerti
    Ge, Rong
    Panigrahi, Debmalya
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [33] Online Metric Algorithms with Untrusted Predictions
    Antoniadis, Antonios
    Coester, Christian
    Elias, Marek
    Polak, Adam
    Simon, Bertrand
    ACM TRANSACTIONS ON ALGORITHMS, 2023, 19 (02)
  • [34] Smoothed Online Optimization with Unreliable Predictions
    Rutten, Daan
    Christianson, Nicolas
    Mukherjee, Debankur
    Wierman, Adam
    PROCEEDINGS OF THE ACM ON MEASUREMENT AND ANALYSIS OF COMPUTING SYSTEMS, 2023, 7 (01)
  • [35] Online Resource Allocation with Noisy Predictions
    Maghakian J.
    Performance Evaluation Review, 2023, 50 (03): : 24 - 27
  • [36] Augmenting Online Algorithms with ε-Accurate Predictions
    Gupta, Anupam
    Panigrahi, Debmalya
    Subercaseaux, Bernardo
    Sun, Kevin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [37] Online Simple Knapsack with Bounded Predictions
    Gehnen, Matthias
    Lotze, Henri
    Rossmanith, Peter
    41ST INTERNATIONAL SYMPOSIUM ON THEORETICAL ASPECTS OF COMPUTER SCIENCE, STACS 2024, 2024, 289
  • [38] Online Unit Profit Knapsack with Predictions
    Boyar, Joan
    Favrholdt, Lene M.
    Larsen, Kim S.
    ALGORITHMICA, 2024, 86 (09) : 2786 - 2821
  • [39] Router Power Reduction through Dynamic Performance Control Based on Traffic Predictions
    Ito, Hiroyuki
    Hasegawa, Hiroshi
    Sato, Ken-ichi
    IEICE TRANSACTIONS ON COMMUNICATIONS, 2012, E95B (10) : 3130 - 3138
  • [40] Towards model predictive control: online predictions of ammonium and nitrate removal by using a stochastic ASM
    Stentoft, Peter Alexander
    Munk-Nielsen, Thomas
    Vezzaro, Luca
    Madsen, Henrik
    Mikkelsen, Peter Steen
    Moller, Jan Kloppenborg
    WATER SCIENCE AND TECHNOLOGY, 2019, 79 (01) : 51 - 62