Controlled Martingale Problems And Their Markov Mimics

Siva Athreya, Vivek S. Borkar, Nitya Gadhiwala

Published 2023-09-01Version 1

In this article we prove under suitable assumptions that the marginals of any solution to a relaxed controlled martingale problem on a Polish space $E$ can be mimicked by a Markovian solution of a Markov-relaxed controlled martingale problem. We also show how such `Markov mimics' can be obtained by relative entropy minimisation. We provide many examples where the above results can be applied.