Young measure relaxation gaps for controllable systems with smooth state constraints

In this article, we tackle the problem of the existence of a gap corresponding to Young measure relaxations for state-constrained optimal control problems. We provide a counterexample proving that a gap may occur in a very regular setting, namely for a smooth controllable system state-constrained to the closed unit ball, provided that the Lagrangian density (i.e., the running cost) is non-convex in the control variables. The example is constructed in the setting of sub-Riemannian geometry with the core ingredient being an unusual admissible curve that exhibits a certain form of resistance to state-constrained approximation. Specifically, this curve cannot be approximated by neighboring admissible curves while obeying the state constraint due to the intricate nature of the dynamics near the boundary of the constraint set. This example therefore demonstrates the impossibility of Filippov–Wažewski type approximation in the presence of state constraints. Our example also presents an occupation measure relaxation gap.