Stochastic optimal control in infinite dimensions with state constraints

被引:1
|
作者
Moon, Jun [1 ]
机构
[1] Hanyang Univ, Dept Elect Engn, Seoul 04763, South Korea
基金
新加坡国家研究基金会;
关键词
State-constrained control problem; Hamilton-Jacobi-Bellman equation; Viscosity solution; Backward reachability analysis; ininfinitedimensions; HAMILTON-JACOBI EQUATIONS; PARTIAL-DIFFERENTIAL-EQUATIONS; VISCOSITY SOLUTIONS; TARGET PROBLEMS; HILBERT-SPACES; EXISTENCE; SYSTEMS; SPDES;
D O I
10.1016/j.na.2022.113050
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We consider the state-constrained stochastic optimal control problem in infinitedimensional separable Hilbert spaces, where the state process is driven by the Q-Wiener process and the (possibly unbounded) linear operator. By applying the stochastic target theory and the backward reachability approach, we show that the original (possibly discontinuous) value function can be represented by the zero-level set of the auxiliary (continuous) value function. The auxiliary value function is obtained from the penalized unconstrained stochastic control problem (in infinite dimensions) that includes an additional control variable as a consequence of the (infinite-dimensional) martingale representation theorem. We then prove that the auxiliary value function is a unique (continuous) viscosity solution to the associated Hamilton-Jacobi-Bellman (HJB) equation in infinite dimensions. Note that the viscosity analysis developed in our paper generalizes that presented in the existing literature, since the corresponding infinite-dimensional HJB equation includes an additional operator-valued control variable in the Hamiltonian maximization and depends on an additional initial state variable. (c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:27
相关论文
共 50 条
  • [1] Necessary conditions for stochastic optimal control problems in infinite dimensions
    Frankowska, Helene
    Zhang, Xu
    STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2020, 130 (07) : 4081 - 4103
  • [2] Approximating infinite horizon stochastic optimal control in discrete time with constraints
    Lisa A. Korf
    Annals of Operations Research, 2006, 142 : 165 - 186
  • [3] Approximating infinite horizon stochastic optimal control in discrete time with constraints
    Korf, LA
    ANNALS OF OPERATIONS RESEARCH, 2006, 142 (01) : 165 - 186
  • [4] Methods for Stochastic Optimal Control under State Constraints
    Rutquist, Per
    ProQuest Dissertations and Theses Global, 2017,
  • [5] On Stochastic Ergodic Control in Infinite Dimensions
    Goldys, Beniamin
    Maslowski, Bohdan
    SEMINAR ON STOCHASTIC ANALYSIS, RANDOM FIELDS AND APPLICATIONS VI, 2011, 63 : 95 - +
  • [7] Optimal control of linear, stochastic systems with state and input constraints
    Batina, I
    Stoorvogel, AA
    Weiland, S
    PROCEEDINGS OF THE 41ST IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-4, 2002, : 1564 - 1569
  • [8] NECESSARY CONDITIONS FOR INFINITE HORIZON OPTIMAL CONTROL PROBLEMS WITH STATE CONSTRAINTS
    Basco, Vincenzo
    Cannarsa, Piermarco
    Frankowska, Helene
    MATHEMATICAL CONTROL AND RELATED FIELDS, 2018, 8 (3-4) : 535 - 555
  • [9] Optimal control of delay-differential inclusions with functional endpoint constraints in infinite dimensions
    Mordukhovich, Boris S.
    Wang, Dong
    Wang, Lianwen
    NONLINEAR ANALYSIS-THEORY METHODS & APPLICATIONS, 2009, 71 (12) : E2740 - E2749
  • [10] Stochastic linear quadratic optimal control problem with terminal state constraints
    Wang, Hongxia
    Hu, Yuxi
    Liu, Yihang
    Xu, Zhihao
    Song, Lianfeng
    ASIAN JOURNAL OF CONTROL, 2024, 26 (03) : 1564 - 1573