arXiv Analytics

Sign in

arXiv:1108.0128 [math.OC]AbstractReferencesReviewsResources

Delay Optimal Multichannel Opportunistic Access

Shiyao Chen, Lang Tong, Qing Zhao

Published 2011-07-31Version 1

The problem of minimizing queueing delay of opportunistic access of multiple continuous time Markov channels is considered. A new access policy based on myopic sensing and adaptive transmission (MS-AT) is proposed. Under the framework of risk sensitive constrained Markov decision process with effective bandwidth as a measure of queueing delay, it is shown that MS-AT achieves simultaneously throughput and delay optimality. It is shown further that both the effective bandwidth and the throughput of MS-AT are two-segment piece-wise linear functions of the collision constraint (maximum allowable conditional collision probability) with the effective bandwidth and throughput coinciding in the regime of tight collision constraints. Analytical and simulations comparisons with the myopic sensing and memoryless transmission (MS-MT) policy which is throughput optimal but delay suboptimal in the regime of tight collision constraints.

Related articles: Most relevant | Search more
arXiv:2101.10895 [math.OC] (Published 2021-01-26)
A Primal-Dual Approach to Constrained Markov Decision Processes
arXiv:2206.01666 [math.OC] (Published 2022-06-03)
Algorithm for Constrained Markov Decision Process with Linear Convergence
arXiv:2110.11383 [math.OC] (Published 2021-10-21, updated 2022-09-24)
Finite-Time Complexity of Online Primal-Dual Natural Actor-Critic Algorithm for Constrained Markov Decision Processes