Skip to main content

Batch Arrival Multiserver Queue with State-Dependent Setup for Energy-Saving Data Center

  • Chapter
  • First Online:
Applied Probability and Stochastic Processes

Part of the book series: Infosys Science Foundation Series ((ISFM))

Abstract

Queues with setup time are extensively studied because they have application in performance evaluation of power-saving data centers. In data centers, there are a huge number of servers which consume a large amount of energy. In the current technology, an idle server still consumes about 60% of the energy when it is busy. Thus, a simple way to save energy is to turn off idle servers. However, when there are some waiting jobs, we have to turn on the OFF servers in order to reduce the waiting time. A server needs some setup time to be active during which it consumes energy but cannot process jobs. Therefore, there exists a trade-off between power consumption and delay performance. Gandhi et al. (Eval Rev 38:48–50, 2010; Perform Eval 67:1123–1138, 2010) analyze this trade-off using an M/M/c queue with staggered setup (one server in setup at a time). In this paper, using an alternative approach, we obtain generating functions for the joint stationary distribution of the number of active servers and that of jobs in the system for a more general model with batch arrivals and state-dependent setup time. We further obtain moments for the joint queue length. Numerical results reveal that under the same traffic intensity, the mean power consumption decreases with the mean batch size. One of the main theoretical contributions is a new conditional decomposition formula showing that the number of waiting customers under the condition that all servers are busy can be decomposed to the sum of two independent random variables with clear physical interpretation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 44.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 59.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 59.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Adan, I.J., Van Leeuwaarden, J.S.H., Winands, E.M.: On the application of Rouche’s theorem in queueing theory. Oper. Res. Lett. 34, 355–360 (2006)

    Article  MathSciNet  Google Scholar 

  2. Artalejo, J.R., Economou, A., Lopez-Herrero, M.J.: Analysis of a multiserver queue with setup times. Queue. Syst. 51, 53–76 (2005)

    Article  MathSciNet  Google Scholar 

  3. Barroso, L.A., Holzle, U.: The case for energy-proportional computing. Computer 40, 33–37 (2007)

    Article  Google Scholar 

  4. Burke, P.J.: Delays in single-server queues with batch input. Oper. Res. 23, 830–833 (1975)

    Article  MathSciNet  Google Scholar 

  5. Chen, Y., Das, A., Qin, W., Sivasubramaniam, A., Wang, Q., Gautam, N.: Managing server energy and operational costs in hosting centers. ACM SIGMETRICS Perform. Eval. Rev. 33, 303–314 (2005)

    Article  Google Scholar 

  6. Choudhury, G.: On a batch arrival Poisson queue with a random setup time and vacation period. Comput. Oper. Res. 25, 1013–1026 (1998)

    Article  MathSciNet  Google Scholar 

  7. Choudhury, G.: An M X/G/1 queueing system with a setup period and a vacation period. Queue. Syst. 36, 23–38 (2000)

    Article  MathSciNet  Google Scholar 

  8. Cromie, M.V., Chaudhry, M.L., Grassmann, W.K.: Further results for the queueing system M X/M/c. J. Oper. Res. Soc. 30, 755–763 (1979)

    MathSciNet  MATH  Google Scholar 

  9. Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Commun. ACM 51(1), 107–113 (2008)

    Article  Google Scholar 

  10. Fuhrmann, S.W., Cooper, R.B.: Stochastic decompositions in the M/G/1 queue with generalized vacations. Oper. Res. 33(5), 1117–1129 (1985)

    Article  MathSciNet  Google Scholar 

  11. Gandhi, A., Harchol-Balter, M.: How data center size impacts the effectiveness of dynamic power management. In: Proceedings of 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton), pp. 1164–1169 (2011)

    Google Scholar 

  12. Gandhi, A., Harchol-Balter, M.: M/G/k with staggered setup. Oper. Res. Lett. 41, 317–320 (2013)

    Article  MathSciNet  Google Scholar 

  13. Gandhi, A., Harchol-Balter, M., Adan, I.: Decomposition results for an M/M/k with staggered setup. ACM SIGMETRICS Perform. Eval. Rev. 38, 48–50 (2010)

    Article  Google Scholar 

  14. Gandhi, A., Harchol-Balter, M., Adan, I.: Server farms with setup costs. Perform. Eval. 67, 1123–1138 (2010)

    Article  Google Scholar 

  15. Gandhi, A., Gupta, V., Harchol-Balter, M., Kozuch, M.A.: Optimality analysis of energy-performance trade-off for server farm management. Perform. Eval. 67, 1155–1171 (2010)

    Article  Google Scholar 

  16. Gandhi, A., Harchol-Balter, M., Kozuch, M.A.: The case for sleep states in servers. In: Proceedings of the 4th Workshop on Power-Aware Computing and Systems (2011). Article no. 2

    Google Scholar 

  17. Greenberg, A., Hamilton, J., Maltz, D.A., Patel, P.: The cost of a cloud: research problems in data center networks. ACM SIGCOMM Comput. Commun. Rev. 39, 68–73 (2008)

    Article  Google Scholar 

  18. Mazzucco, M., Dyachuk, D.: Balancing electricity bill and performance in server farms with setup costs. Future Gener. Comput. Syst. 28, 415–426 (2012)

    Article  Google Scholar 

  19. Meisner, D., Gold, B.T., Wenisch, T.F.: PowerNap: eliminating server idle power. ACM Sigplan Not. 44, 205–216 (2009)

    Article  Google Scholar 

  20. Mitrani, I.: Service center trade-offs between customer impatience and power consumption. Perform. Eval. 68, 1222–1231 (2011)

    Article  Google Scholar 

  21. Mitrani, I.: Trading power consumption against performance by reserving blocks of servers. In: Computer Performance Engineering. Springer, Berlin (2013), pp. 1–15

    Google Scholar 

  22. Mitrani, I.: Managing performance and power consumption in a server farm. Ann. Oper. Res. 202, 121–134 (2013)

    Article  MathSciNet  Google Scholar 

  23. Phung-Duc, T.: Impatient customers in power-saving data centers. In: Proceedings of 21th International Conference on Analytical and Stochastic Modeling Techniques and Applications (ASMTA 2014), Lecture Notes in Computer Science LNCS 8499. Springer, Cham (2014), pp. 185–199

    Google Scholar 

  24. Phung-Duc, T.: Server farms with batch arrival and staggered setup. In: Proceedings of the Fifth Symposium on Information and Communication Technology (SoICT). ACM, New York (2014), pp. 240–247

    Google Scholar 

  25. Phung-Duc, T.: Multiserver queues with finite capacity and setup time. In: International Conference on Analytical and Stochastic Modeling Techniques and Applications, Lecture Notes in Computer Science LNCS 9081. Springer, Cham (2015), pp. 173–187

    Google Scholar 

  26. Phung-Duc, T.: Exact solutions for M/M/c/setup queues. Telecommun. Syst. 64(2), 309–324 (2017)

    Article  Google Scholar 

  27. Schwartz, C., Pries, R., Tran-Gia, P.: A queuing analysis of an energy-saving mechanism in data centers. In: Proceedings of International Conference on Information Networking (ICOIN) (2012), pp. 70–75

    Google Scholar 

  28. Takagi, H.: Priority queues with setup times. Oper. Res. 38, 667–677 (1990)

    Article  MathSciNet  Google Scholar 

  29. Tian, N., Li, Q.L., Gao, J.: Conditional stochastic decompositions in the M/M/c queue with server vacations. Stoch. Models 15, 367–377 (1999)

    Article  MathSciNet  Google Scholar 

  30. Wolfgang, B.: Analysis of M/G/1-queues with setup times and vacations under six different service disciplines. Queue. Syst. 39, 265–301 (2001)

    Article  MathSciNet  Google Scholar 

  31. Zhang, Z.G., Tian, N.: Analysis of queueing systems with synchronous single vacation for some servers. Queue. Syst. 45, 161–175 (2003)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tuan Phung-Duc .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 The Editor(s) (if applicable) and The Author(s), under exclusive licence to Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Phung-Duc, T. (2020). Batch Arrival Multiserver Queue with State-Dependent Setup for Energy-Saving Data Center. In: Joshua, V., Varadhan, S., Vishnevsky, V. (eds) Applied Probability and Stochastic Processes. Infosys Science Foundation Series(). Springer, Singapore. https://doi.org/10.1007/978-981-15-5951-8_25

Download citation

Publish with us

Policies and ethics