Stability Analysis of Optimal Adaptive Control Using Value Iteration With Approximation Errors

被引：50
|
作者：
Heydari, Ali [1 ]
机构：
[1] Southern Methodist Univ, Dept Mech Engn, Dallas, TX 75205 USA
来源：
IEEE TRANSACTIONS ON AUTOMATIC CONTROL | 2018年 / 63卷 / 09期
基金：
美国国家科学基金会;
关键词：
Adaptive dynamic programming; approximation error; stability analysis; value iteration; TIME NONLINEAR-SYSTEMS; CONVERGENCE;
D O I：
10.1109/TAC.2018.2790260
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Effects of the presence of approximation errors are analyzed on the stability of adaptive optimal control using value iteration, initiated from a stabilizing control policy. This analysis includes the system operated using any single/constant resulting control policy and also using an evolving/time-varying control policy. Sufficient conditions on the 'per iteration' approximation errors are obtained for guaranteeing the stability. A feature of the presented results is providing estimations of the region of attraction, under the approximation errors, so that if the initial condition is within this region, the whole trajectory will remain inside the training region, and hence, the function approximation results remain reliable.
引用
收藏
页码：3119 / 3126
页数：8
相关论文
共 50 条
  • [41] An accelerated value/policy iteration scheme for optimal control problems and games
    University of Hamburg, Bundesstraße 55, Hamburg, Germany
    不详
    不详
    Lect. Notes Comput. Sci. Eng., (489-497):
  • [42] Analysis and robust optimal design of iteration learning control
    Xu, JX
    Tan, Y
    PROCEEDINGS OF THE 2003 AMERICAN CONTROL CONFERENCE, VOLS 1-6, 2003, : 3038 - 3043
  • [43] Value Iteration-Based Cooperative Adaptive Optimal Control for Multi-Player Differential Games With Incomplete Information
    Yun Zhang
    Lulu Zhang
    Yunze Cai
    IEEE/CAA Journal of Automatica Sinica, 2024, 11 (03) : 690 - 697
  • [44] Value Iteration-Based Cooperative Adaptive Optimal Control for Multi-Player Differential Games With Incomplete Information
    Zhang, Yun
    Zhang, Lulu
    Cai, Yunze
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2024, 11 (03) : 690 - 697
  • [45] Adaptive Optimal Control of Unknown Constrained-Input Systems Using Policy Iteration and Neural Networks
    Modares, Hamidreza
    Lewis, Frank L.
    Naghibi-Sistani, Mohammad-Bagher
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2013, 24 (10) : 1513 - 1525
  • [46] Nonlinear overtaking optimal control: Sufficiency, stability, and approximation
    Tan, HL
    Rugh, WJ
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1998, 43 (12) : 1703 - 1718
  • [47] Adaptive finite element analysis of nonlinear problems: balancing of discretization and iteration errors
    Rannacher, R.
    Vihharev, J.
    JOURNAL OF NUMERICAL MATHEMATICS, 2013, 21 (01) : 23 - 61
  • [48] Data-driven Robust Optimal Control Design for Uncertain Cascaded Systems Using Value Iteration
    Bian, Tao
    Jiang, Zhong-Ping
    2015 54TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2015, : 7610 - 7615
  • [49] Stochastic Optimal Control using Local Sample-based Value Function Approximation
    Dolgov, Maxim
    Kurz, Gerhard
    Grimm, Daniela
    Rosenthal, Florian
    Hanebeck, Uwe D.
    2018 ANNUAL AMERICAN CONTROL CONFERENCE (ACC), 2018, : 2145 - 2150
  • [50] Event-triggered adaptive fuzzy optimal control of modular robot manipulators using zero-sum differential game through value iteration
    Dong, Bo
    Feng, Zhian
    Cui, Yiming
    Zhu, Xinye
    An, Tianjiao
    INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2023, 37 (09) : 2364 - 2379
12345