First and Second Order Necessary Conditions for Stochastic Optimal Control Problems

被引:44
|
作者
Bonnans, J. Frederic [1 ,2 ,3 ]
Silva, Francisco J. [4 ]
机构
[1] Ecole Polytech, INRIA Saclay, F-91128 Palaiseau, France
[2] Ecole Polytech, CMAP, F-91128 Palaiseau, France
[3] Lab Finance Marches Energie, Paris, France
[4] Dipartimento Matemat Guido Castelnuovo, I-00185 Rome, Italy
来源
APPLIED MATHEMATICS AND OPTIMIZATION | 2012年 / 65卷 / 03期
关键词
Stochastic optimal control; Variational approach; First and second order optimality conditions; Polyhedric constraints; Final state constraints; JACOBI-BELLMAN EQUATIONS; MAXIMUM PRINCIPLE; DIFFUSION-PROCESSES;
D O I
10.1007/s00245-012-9162-4
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this work we consider a stochastic optimal control problem with either convex control constraints or finitely many equality and inequality constraints over the final state. Using the variational approach, we are able to obtain first and second order expansions for the state and cost function, around a local minimum. This fact allows us to prove general first order necessary condition and, under a geometrical assumption over the constraint set, second order necessary conditions are also established. We end by giving second order optimality conditions for problems with constraints on expectations of the final state.
引用
收藏
页码:403 / 439
页数:37
相关论文
共 50 条
  • [1] First and Second Order Necessary Conditions for Stochastic Optimal Control Problems
    J. Frédéric Bonnans
    Francisco J. Silva
    Applied Mathematics & Optimization, 2012, 65 : 403 - 439
  • [2] Second-Order Necessary Conditions for Stochastic Optimal Control Problems
    Zhang, Haisen
    Zhang, Xu
    SIAM REVIEW, 2018, 60 (01) : 139 - 178
  • [3] Second Order Necessary Conditions for Optimal Control Problems of Stochastic Evolution Equations
    Qi, Lu
    PROCEEDINGS OF THE 35TH CHINESE CONTROL CONFERENCE 2016, 2016, : 2620 - 2625
  • [4] SECOND ORDER NECESSARY CONDITIONS FOR OPTIMAL CONTROL PROBLEMS OF STOCHASTIC EVOLUTION EQUATIONS
    Lu, Qi
    Zhang, Haisen
    Zhang, Xu
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2021, 59 (04) : 2924 - 2954
  • [5] First and second order necessary conditions for stochastic optimal controls
    Frankowska, Helene
    Zhang, Haisen
    Zhang, Xu
    JOURNAL OF DIFFERENTIAL EQUATIONS, 2017, 262 (06) : 3689 - 3736
  • [6] Algorithms for Nonlinear Optimal Control Problems Based on the First and Second Order Necessary Conditions
    Tyatyushkin A.I.
    Zarodnyuk T.S.
    Gornov A.Y.
    Journal of Mathematical Sciences, 2019, 239 (2) : 185 - 196
  • [7] On necessary second-order conditions in optimal control problems
    Arutyunov, AV
    Vereshchagina, YS
    DIFFERENTIAL EQUATIONS, 2002, 38 (11) : 1531 - 1540
  • [8] On Necessary Second-Order Conditions in Optimal Control Problems
    A. V. Arutyunov
    Yu. S. Vereshchagina
    Differential Equations, 2002, 38 : 1531 - 1540
  • [9] Second Order Necessary Conditions for Optimal Impulsive Control Problems
    A. Arutyunov
    V. Jaćimović
    F. Pereira
    Journal of Dynamical and Control Systems, 2003, 9 : 131 - 153
  • [10] Second order necessary conditions for optimal impulsive control problems
    Arutyunov, A
    Jacimovic, V
    Pereira, F
    JOURNAL OF DYNAMICAL AND CONTROL SYSTEMS, 2003, 9 (01) : 131 - 153