Abstract
An optimal policy to minimize the queue length in a multi-server controllable queueing system with heterogeneous servers has a threshold property, and it uses the fastest server if necessary (see [8] and [17]). This study gives a numerical description of optimal policies that minimize the operational cost for such a system.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
E. Altman and G. Koole, On submodular functions of dynamic programming, Technical Report 2658, INRIA, Sophia Antipolis (1995).
P. Glasserman and D.D. Yao, Monotone Structure in Discrete Event Systems (Wiley, New York, 1994).
R.A. Howard, Dynamic Programming and Markov Processes (Wiley, New York, 1960).
W.S. Jewell, Controllable semi-Markov processes, Cybernet. Sb. 4 (1967) 97–137.
M. Yu. Kitaev and V.V. Rykov, Controlled Queueing Systems (CRC Press, New York, 1995).
P. Langrock and W.W. Rykow, Methoden und Modelle zur Steurung von Bedienungssystemen, in: Handbuch der Bedienungstheorie B, Vol. 2 (Akademie-Verlag, Berlin, 1984) pp. 422–486.
O.H. Lerma and J.B. Lassere, Discrete-Time Markov Control Processes, Applications of Mathematics (Springer, New York, 1996).
W. Lin and P.R. Kumar, Optimal control of a queueing system with two heterogeneous servers, IEEE Trans. Automat. Control 29 (1984) 696–703.
H.P. Luh and I. Viniotis, Threshold control policies for heterogeneous server systems, Math. Methods Oper. Res. 55 (2002) 121–142.
H. Mine and S. Osaki, Markovian Decision Processes, Vol. XI (Elsevier, Amsterdam, 1970).
A.B. Piunovskiy, Optimal Control of Random Sequences in Problems with Constraints (Kluwer Academic, Dordrecht, 1997).
M.L. Puterman, Markov Decision Processes, Wiley Series in Probability and Mathematical Statistics (Wiley, New York, 1994).
Sh. Ross, Applied Probability Models with Optimization Applications (Holden Day, San Francisco, CA, 1970).
V.V. Rykov, Markov decision processes with finite state and decision spaces, Probab. Theory Appl. 11(2) (1966) 302–311.
V.V. Rykov, Controllable queueing systems, in: Itogi Nauki i Techniki. Teoria Verojatn. Matem. Statist. Teoretich. Kibern., Vol. 12 (1975) (In Russian) pp. 45–152. English translation in Soviet Math.
V.V. Rykov, On monotonicity conditions for optimal policies for controlling queueing systems, Automat. Remote Control 60(9) (1999) 1290–1301.
V.V. Rykov, Monotone Control of queueing systems with heterogeneous servers, Queueing Systems 37 (2001) 391–403.
L. Sennott, Stochastic Dynamic Programming and Control of Queueing Systems (Wiley, New York, 1999).
Sh. Stidham Jr., Optimal control of admission to a queueing system, IEEE Trans. Automat. Control 30 (1985) 705–713.
Sh. Stidham Jr. and R. Weber, A survey of Markov decision models for control of networks of queues, Queueing Systems 13 (1993) 291–314.
D. Topkis, Minimizing a submodular function on a lattice, Oper. Res. 26(2) (1978) 305–321.
F. Wolf and G. Danzig, Markov chains and linear programming, Cybernet. Sb. 4 (1967) 86–96.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Rykov, V., Efrosinin, D. Optimal Control of Queueing Systems with Heterogeneous Servers. Queueing Systems 46, 389–407 (2004). https://doi.org/10.1023/B:QUES.0000027992.91461.1e
Issue Date:
DOI: https://doi.org/10.1023/B:QUES.0000027992.91461.1e