Abstract
Many queuing processes have a semi-infinite strip in the two-dimensional plane as state space. As an alternative to well-established algorithms for the computation of steady-state probabilities, such as the matrix-geometric method and the spectral method, this article discusses a simple and easy-to-implement algorithm which is based on the geometric tail behavior of the steady-state probabilities. Some numerical comparisons between this algorithm and the spectral method are presented.
Similar content being viewed by others
References
M. Cromie, M. Chaudry and W. Grassmann, Further results for the queueing system M x /M/c, Journal of the Operational Research Society 30 (1979) 755-761.
J. Daigle and D. Lucantoni, Queueing systems having phase-dependent arrival and service rates, in: Numerical Solutions of Markov Chains, ed. W. Stewart (Marcel Dekker, 1991) pp. 161-202.
J. Everett, State probabilities in congestion problems characterized by constant holding times, Operations Research 1 (1954) 279-285.
W. Feller, An Introduction to Probability Models and its Applications, Vol. I, 1st ed. (Wiley, New York, 1950).
H. Gail, S. Hantler and B. Taylor, Use of characteristic roots for solving infinite state Markov chains, in: Computational Probability, ed. W. Grassmann (Kluwer, Dordrecht, 2000) pp. 205-254.
B. Haverkort and R. Ost, Steady-state analysis of infinite stochastic Petri nets: Comparing the spectral expansion and the matrix geometric method, in: Proceedings of 7th International Workshop on Petri Nets and Performance Models (IEEE Computer Society Press, 1997) pp. 36-45.
G. Latouche and V. Ramaswami, A logarithmic reduction algorithm for quasi-birth-death processes, Journal of Applied Probability 30 (1993) 650-674.
I. Mitrani and R. Chakka, Spectral expansion solution for a class of Markov models: Application and comparison with the matrix-geometric method, Performance Evaluation 23 (1995) 241-260.
I. Mitrani and D. Mitra, A spectral expansion method for random walks on semi-infinite strips, in: Iterative Methods in Linear Algebra, eds. R. Beauwens and P. de Groen (North-Holland, Amsterdam, 1992) pp. 141-149.
M. Neuts, Matrix-Geometric Solutions in Stochastic Models (Johns Hopkins University Press, Baltimore, MD, 1981).
Y. Takahashi and Y. Takami, A numerical method for the steady state probabilities in a GI/G/c queueing system in a general class, Journal of the Operations Research Society of Japan (1976) 137-148.
H. Tijms, Stochastic Models (Wiley, Chichester, 1994).
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Tijms, H., van Vuuren, D. Markov Processes on a Semi-Infinite Strip and the Geometric Tail Algorithm. Annals of Operations Research 113, 133–140 (2002). https://doi.org/10.1023/A:1020909928743
Issue Date:
DOI: https://doi.org/10.1023/A:1020909928743