Existence of Markov equilibrium control in discrete time - Erhan Bayraktar; Bingyan Han (2023)