Stochastic optimal control in infinite dimensions with state constraints

被引:1
|
作者
Moon, Jun [1 ]
机构
[1] Hanyang Univ, Dept Elect Engn, Seoul 04763, South Korea
基金
新加坡国家研究基金会;
关键词
State-constrained control problem; Hamilton-Jacobi-Bellman equation; Viscosity solution; Backward reachability analysis; ininfinitedimensions; HAMILTON-JACOBI EQUATIONS; PARTIAL-DIFFERENTIAL-EQUATIONS; VISCOSITY SOLUTIONS; TARGET PROBLEMS; HILBERT-SPACES; EXISTENCE; SYSTEMS; SPDES;
D O I
10.1016/j.na.2022.113050
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We consider the state-constrained stochastic optimal control problem in infinitedimensional separable Hilbert spaces, where the state process is driven by the Q-Wiener process and the (possibly unbounded) linear operator. By applying the stochastic target theory and the backward reachability approach, we show that the original (possibly discontinuous) value function can be represented by the zero-level set of the auxiliary (continuous) value function. The auxiliary value function is obtained from the penalized unconstrained stochastic control problem (in infinite dimensions) that includes an additional control variable as a consequence of the (infinite-dimensional) martingale representation theorem. We then prove that the auxiliary value function is a unique (continuous) viscosity solution to the associated Hamilton-Jacobi-Bellman (HJB) equation in infinite dimensions. Note that the viscosity analysis developed in our paper generalizes that presented in the existing literature, since the corresponding infinite-dimensional HJB equation includes an additional operator-valued control variable in the Hamiltonian maximization and depends on an additional initial state variable. (c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:27
相关论文
共 50 条
  • [31] Stochastic approximation in infinite dimensions
    Karandikar, Rajeeva L.
    Rao, B. V.
    INFINITE DIMENSIONAL ANALYSIS QUANTUM PROBABILITY AND RELATED TOPICS, 2024, 27 (04)
  • [32] BACKWARD SDES AND INFINITE HORIZON STOCHASTIC OPTIMAL CONTROL
    Confortola, Fulvia
    Cosso, Andrea
    Fuhrman, Marco
    ESAIM-CONTROL OPTIMISATION AND CALCULUS OF VARIATIONS, 2019, 25
  • [33] STOCHASTIC INPUT-TO-STATE STABILITY OF IMPULSIVE STOCHASTIC NONLINEAR SYSTEMS IN INFINITE DIMENSIONS
    Wang, Pengfei
    Wang, Shuaiqi
    Su, Huan
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2021, 59 (04) : 2774 - 2797
  • [34] NECESSARY OPTIMALITY CONDITIONS FOR LOCAL MINIMIZERS OF STOCHASTIC OPTIMAL CONTROL PROBLEMS WITH STATE CONSTRAINTS
    Frankowska, Helene
    Zhang, Haisen
    Zhang, Xu
    TRANSACTIONS OF THE AMERICAN MATHEMATICAL SOCIETY, 2019, 372 (02) : 1289 - 1331
  • [35] Optimal Covariance Control for Stochastic Linear Systems Subject to Integral Quadratic State Constraints
    Bakolas, Efstathios
    2016 AMERICAN CONTROL CONFERENCE (ACC), 2016, : 7231 - 7236
  • [36] Study on Stochastic Linear Quadratic Optimal Control with Quadratic and Mixed Terminal State Constraints
    Yang Hongli
    JOURNAL OF APPLIED MATHEMATICS, 2013,
  • [37] The optimal control problem with state constraints for forward-backward stochastic systems with jumps
    Wei, Qingmeng
    IMA JOURNAL OF MATHEMATICAL CONTROL AND INFORMATION, 2017, 34 (02) : 463 - 478
  • [38] Optimal Control under State Constraints
    Frankowska, Helene
    PROCEEDINGS OF THE INTERNATIONAL CONGRESS OF MATHEMATICIANS, VOL IV: INVITED LECTURES, 2010, : 2915 - 2942
  • [39] Pareto optimal control for mixed Neumann infinite-order parabolic system with state-control constraints
    Bahaa, G. M.
    El-Marouf, S. A. A.
    Embaby, O. A.
    JOURNAL OF TAIBAH UNIVERSITY FOR SCIENCE, 2015, 9 (02): : 264 - 273
  • [40] Fractional optimal control problem for infinite order system with control constraints
    Bahaa, G. Mohamed
    ADVANCES IN DIFFERENCE EQUATIONS, 2016,