Stochastic Scheduling Subject to Preemptive-Repeat Breakdowns with Incomplete Information

• Published in: Operations research Vol. 57; no. 5; pp. 1236 - 1249
• Main Authors: Cai, Xiaoqiang, Wu, Xianyi, Zhou, Xian
• Format: Journal Article
• Language: English
• Published: Hanover, MD INFORMS 01.09.2009; Institute for Operations Research and the Management Sciences
• Subjects: Analysis; Applied sciences; Dynamic programming; dynamic programming/optimal control; Exact sciences and technology; Information modeling; Information operations; learning; Markov processes; Mass production; Mathematical programming; Mathematical sequences; Operational research and scientific management; Operational research. Management science; Operations research; Optimal policy; Probability; Probability distributions; Production scheduling; Random variables; Scheduling; Scheduling, sequencing; semi-Markov; stochastic; Stochastic analysis; stochastic model applications; Stochastic models; Stopping distances; Studies; United States; Performance evaluation; Markov process; Preemption; Stochastic model; Optimal policy; Processing time; learning; History; Modeling; Dynamic conditions; Uncertain system; Dynamic programming; Incomplete information; Random variable; Posterior distribution; Single machine; Execution time; Probabilistic approach; Prior distribution; Scheduling; production/scheduling: stochastic; Stochastic programming; Exact solution; Production management; Optimal control; Reward; probability: stochastic model applications; By product; dynamic programming/optimal control: semi-Markov
• DOI: 10.1287/opre.1080.0660
• ISSN: 0030-364X

This paper considers the problem of scheduling a set of jobs on a single machine subject to stochastic breakdowns with incomplete information on the probability distributions involved in the decision process. We focus on the preemptive-repeat discipline, under which a machine breakdown leads to the loss of the work done on the job being processed. The breakdown process of the machine is allowed to depend on the job it is processing. The processing times required to complete the jobs, and the machine uptimes and downtimes, are random variables with incomplete information on their probability distributions characterized by unknown parameters. We establish the preemptive-repeat model with incomplete information and investigate its probabilistic characteristics. We show that optimal static policies can be obtained for a wide range of performance measures, which are determined by the prior distributions of the unknown parameters. We derive optimal dynamic policies via Gittins indices represented by the posterior distributions, which are updated adaptively based on processing histories. Under appropriate conditions, the optimal dynamic policies can be calculated by one-step reward rates in a closed form. As a by-product, we also show that our incomplete information model subsumes the traditional preemptive-repeat models with complete information as extreme cases.