Finite state N-agent and mean field control problems

Alekos Cecchin

Published 2020-10-22Version 1

We examine mean field control problems (MFCP) on a finite state space, in continuous time and over a finite time horizon. We characterize the value function of the MFCP as the unique viscosity solution of a HJB equation in the simplex. In absence of any convexity assumption, we exploit this characterization to prove convergence, as $N$ grows, of the value functions of the centralized $N$-agent optimal control problem to the limit MFCP value function, with a convergence rate of order $1/\sqrt{N}$. Then, assuming convexity, we show that the limit HJB admits a smooth solution and establish propagation of chaos, i.e. convergence of the $N$-agent optimal trajectory to the unique limiting optimal trajectory, with an explicit rate.