arXiv Analytics

Sign in

arXiv:2303.11576 [math.PR]AbstractReferencesReviewsResources

On the Existence and Uniqueness of Stationary Distributions for Some Class of Piecewise Deterministic Markov Processes With State-Dependent Jump Intensity

Dawid Czapla

Published 2023-03-21Version 1

In this paper, we are concerned with a class of piecewise deterministic Markov processes that involve a deterministic motion punctuated by random jumps, occurring in a Poisson-like fashion with some state-dependent rate, between which, at any time, the trajectory is driven by one of the given semiflows, randomly drawn right after the jump. We prove that there is a one-to-one correspondence between stationary distributions of such processes and those of the discrete-time Markov chains given by their post-jump locations. Further, we apply this result to provide a criterion guaranteeing the existence and uniqueness of the stationary distribution in a particular case, where the post-jump locations result from the action of an iterated function system with place-dependent probabilities.

Related articles: Most relevant | Search more
arXiv:0902.2673 [math.PR] (Published 2009-02-16)
The Policy Iteration Algorithm for Average Continuous Control of Piecewise Deterministic Markov Processes
arXiv:0812.0820 [math.PR] (Published 2008-12-03)
The Vanishing Approach for the Average Continuous Control of Piecewise Deterministic Markov Processes
arXiv:1602.07871 [math.PR] (Published 2016-02-25)
Exact simulation of the jump times of a class of Piecewise Deterministic Markov Processes