Discontinuous Solutions to Unbounded Differential Inclusions under State Constraints. Applications to Optimal Control Problems

We consider a nonconvex and unbounded differential inclusion derived from a control system whose control sets are time and space-dependent. We extend the inclusion in order to allow discontinuous trajectories. We prove that the set of solutions of the original inclusion is dense in the set of solutions of the extended inclusion and, moreover, these last solutions are stable with respect to the initial data. Both of these results are also proven in the presence of state and integral constraints (assuming suitable conditions at the boundary of the constraining set). As an application, the value function of a Mayer problem is shown to be continuous and the unique viscosity solution of a Hamilton–Jacobi equation with suitable boundary conditions.