TWO-CLASS ROUTING WITH ADMISSION CONTROL AND STRICT PRIORITIES

• Published in: Probability in the engineering and informational sciences Vol. 32; no. 2; pp. 163 - 178
• Main Authors: Chong, Kenneth C., Henderson, Shane G., Lewis, Mark E.
• Format: Journal Article
• Language: English
• Published: New York, USA Cambridge University Press 01.04.2018
• Subjects: Admission control; Decision making; Markov processes; Policies; queueing control; Markov decision processes; stochastic dynamic programming; two-class queue
• ISSN: 0269-9648; 1469-8951
• DOI: 10.1017/S0269964817000195

We consider the problem of routing and admission control in a loss system featuring two classes of arriving jobs (high-priority and low-priority jobs) and two types of servers, in which decision-making for high-priority jobs is forced, and rewards influence the desirability of each of the four possible routing decisions. We seek a policy that maximizes expected long-run reward, under both the discounted reward and long-run average reward criteria, and formulate the problem as a Markov decision process. When the reward structure favors high-priority jobs, we demonstrate that there exists an optimal monotone switching curve policy with slope of at least −1. When the reward structure favors low-priority jobs, we demonstrate that the value function, in general, lacks structure, which complicates the search for structure in optimal policies. However, we identify conditions under which optimal policies can be characterized in greater detail. We also examine the performance of heuristic policies in a brief numerical study.