arXiv Analytics

Sign in

arXiv:2103.13256 [math.OC]AbstractReferencesReviewsResources

Markov Decision Processes with Incomplete Information and Semi-Uniform Feller Transition Probabilities

Eugene A. Feinberg, Pavlo O. Kasyanov, Michael Z. Zgurovsky

Published 2021-03-24Version 1

This paper studies average-cost Markov decision processes with semi-uniform Feller transition probabilities. This class of MDPs was recently introduced by the authors to study MDPs with incomplete information. This paper studies the validity of optimality inequalities, the existence of optimal policies, and the approximations of optimal policies by policies optimizing total discounted costs.

Related articles: Most relevant | Search more
arXiv:2108.09232 [math.OC] (Published 2021-08-20)
Markov Decision Processes with Incomplete Information and Semi-Uniform Feller Transition Probabilities
arXiv:1902.10685 [math.OC] (Published 2019-02-27)
On the Minimum Pair Approach for Average-Cost Markov Decision Processes with Countable Discrete Action Space and Strictly Unbounded Costs
arXiv:1202.4122 [math.OC] (Published 2012-02-19)
Average-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities