arXiv Analytics

Sign in

arXiv:2311.03254 [math.OC]AbstractReferencesReviewsResources

Controlled Diffusions under Full, Partial and Decentralized Information: Existence of Optimal Policies and Discrete-Time Approximations

Somnath Pradhan, Serdar Yüksel

Published 2023-11-06Version 1

We present existence and discrete-time approximation results on optimal control policies for continuous-time stochastic control problems under a variety of information structures. These include fully observed models, partially observed models and multi-agent models with decentralized information structures. While there exist comprehensive existence and approximations results for the fully observed setup in the literature, few prior research exists on discrete-time approximation results for partially observed models. For decentralized models, even existence results have not received much attention except for specialized models and approximation has been an open problem. Our existence and approximations results lead to the applicability of well-established partially observed Markov decision processes and the relatively more mature theory of discrete-time decentralized stochastic control to be applicable for computing near optimal solutions for continuous-time stochastic control.

Related articles: Most relevant | Search more
arXiv:2405.16223 [math.OC] (Published 2024-05-25)
Near Optimality of Lipschitz and Smooth Policies in Controlled Diffusions
arXiv:1106.2773 [math.OC] (Published 2011-06-14)
On Optimal Harvesting in Stochastic Environments: Optimal Policies in a Relaxed Model
arXiv:1611.04613 [math.OC] (Published 2016-11-14)
On the Optimal Policies for Visibility-Based Target Tracking