Skip to main content

Advertisement

Log in

Analysis of power consumption in heterogeneous virtual machine environments

  • Focus
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Reduction of energy consumption in Cloud computing datacenters today is a hot a research topic, as these consume large amounts of energy. Furthermore, most of the energy is used inefficiently because of the improper usage of computational resources such as CPU, storage and network. A good balance between the computing resources and performed workload is mandatory. In the context of data-intensive applications, a significant portion of energy is consumed just to keep alive virtual machines or to move data around without performing useful computation. Moreover, heterogeneity of resources increases the difficulty degree, when trying to achieve energy efficiency. Power consumption optimization requires identification of those inefficiencies in the underlying system and applications. Based on the relation between server load and energy consumption, we study the efficiency of data-intensive applications, and the penalties, in terms of power consumption, that are introduced by different degrees of heterogeneity of the virtual machines characteristics in a cluster.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  • Andreas M, Natalia K, Christine S (2012) Towards cloud-centric service environments. J Serv Sci Res 4(2):213–234

    Article  Google Scholar 

  • Andreas B, Hermann D (2011) An energy consumption model for virtualized office environments. Futur Gener Comput Syst 27(8):1047–1055

    Article  Google Scholar 

  • Aroca JA, Anta AF, Mosteiro MA, Thraves C, Wang L (2016) Power-efficient assignment of virtual machines to physical machines. Futur Gener Comput Syst 54:82–94

  • Barroso LA, Clidaras J, Hölzle U (2013) The datacenter as a computer: An introduction to the design of warehouse-scale machines. Synth Lect Comput Archit 8(3):1–154

  • Bessis N, Sotiriadis S, Pop F, Cristea V (2012) Optimizing the energy efficiency of message exchanging for service distribution in interoperable infrastructures. In: Intelligent networking and collaborative systems (INCoS), 2012 4th international conference on IEEE, pp 105–112

  • Bessis N, Sotiriadis S, Pop F, Cristea V (2013) Using a novel message exchanging optimization (meo) model to reduce energy consumption in distributed systems. Simul Model Pract Theory 39:104–120

  • Bircher WL, John LK (2012) Complete system power estimation using processor performance events. Comput IEEE Trans 61(4):563–577

  • Bohra AEH, Chaudhary V (2010) Vmeter: power modelling for virtualized clouds. In: Parallel and distributed processing, workshops and Phd Forum (IPDPSW), 2010 IEEE International Symposium on IEEE, pp 1–8

  • Borthakur D (2008) Hdfs architecture guide. HADOOP APACHE PROJECT http://hadoop.apache.org/common/docs/current/hdfsdesign.pdf

  • Borthakur D, Gray J, Sarma JS, Muthukkaruppan K, Spiegelberg N, Kuang H, Ranganathan K, Molkov D, Menon A, Rash S et al (2011) Apache hadoop goes realtime at facebook. In: Proceedings of the 2011 ACM SIGMOD international conference on management of data ACM, pp 1071–1080

  • Christoph M, Waltenegus D, Alexander S (2014) Power consumption estimation models for processors, virtual machines, and servers. Parallel Distrib Syst IEEE Trans 25(6):1600–1614

    Article  Google Scholar 

  • Copeland M, Soh J, Puca A, Manning M, Gollob D (2015) Microsoft azure and cloud computing. In: Microsoft azure. Apress, New York, pp 3–26

  • Delforge P (2014) America’s data centers consuming and wasting growing amounts of energy. Natural Resource Defense Council. Retrieved from http://www.nrdc.org/energy/data-center-efficiency-assessment.asp

  • Demchenko Y, Grosso P, De Laat C, Membrey P (2013) Addressing big data issues in scientific data infrastructure. In: Collaboration technologies and systems (CTS), 2013 international conference on IEEE, pp 48–55

  • Dorigo M, Birattari M (2010) Ant colony optimization. In: Encyclopedia of machine learning. Springer, New York, pp 36–39

  • Enhanced Intel (2004) Speedstep technology for the intel pentium m processor. Retrieved from http://download.intel.com/design/network/papers/30117401.pdf

  • Ewa N-S, Andrzej S, Piotr A, Mariusz K, Marcin M, Joanna K (2014) Dynamic power management in energy-aware computer networks and data intensive computing systems. Futur Gener Comput Syst 37:284–296

    Article  Google Scholar 

  • Feller E, Rilling L, Morin C (2011) Energy-aware ant colony based workload placement in clouds. In: Proceedings of the 2011 IEEE/ACM 12th international conference on grid computing. IEEE Computer Society, USA, pp 26–33

  • Ficco M, Palmieri F (2015) Introducing fraudulent energy consumption in cloud infrastructures: a new generation of denial-of-service attacks. Syst J IEEE (99):1–11

  • Florin P, Ciprian D, Valentin C, Nik B, Fatos X, Leonard B (2015) Deadline scheduling for aperiodic tasks in inter-cloud environments: a new approach to resource management. J Supercomput 71(5):1754–1765

    Article  Google Scholar 

  • Ghit B, Capota M, Hegeman T, Hidders J, Epema D, Iosup A (2014) V for vicissitude: the challenge of scaling complex big data workflows. In: Cluster, cloud and grid computing (CCGrid), 2014 14th IEEE/ACM international symposium on IEEE, pp 927–932

  • Goudarzi H, Pedram M (2012) Energy-efficient virtual machine replication and placement in a cloud computing system. In: Cloud computing (CLOUD), 2012 IEEE 5th international conference on IEEE, pp 750–757

  • Iordache GV, Boboila MS, Pop F, Stratan C, Cristea V (2006) A decentralized strategy for genetic scheduling in heterogeneous environments. In: On the move to meaningful internet systems 2006: CoopIS, DOA, GADA, and ODBASE. Springer, New York, pp 1234–1251

  • Isard M, Budiu M, Yu Y, Birrell A, Fetterly D (2007) Dryad: distributed data-parallel programs from sequential building blocks. In: ACM SIGOPS operating systems review, vol 41. ACM, New York, pp 59–72

  • Jeffrey D, Sanjay G (2008) Mapreduce: simplified data processing on large clusters. Commun ACM 51(1):107–113

    Article  Google Scholar 

  • Khosravi A, Garg SK, Buyya R (2013) Energy and carbon-efficient placement of virtual machines in distributed cloud data centers. In: Euro-Par 2013 parallel processing. Springer, New York, pp 317–328

  • Kołodziej J, Khan SU, Xhafa F (2011) Genetic algorithms for energy-aware scheduling in computational grids. In: P2P, parallel, grid, cloud and internet computing (3PGCIC), 2011 international conference on IEEE, pp 17–24

  • KołOdziej J, Khan SU (2012) Multi-level hierarchic genetic-based scheduling of independent jobs in dynamic heterogeneous grid environment. Inf Sci 214:1–19

    Article  Google Scholar 

  • Kolodziej J, Szmajduch M, Maqsood T, Madani SA, Min-Allah N, Khan SU (2013a) Energy-aware grid scheduling of independent tasks and highly distributed data. In: Frontiers of information technology (FIT), 2013 11th international conference on IEEE, pp 211–216

  • Kolodziej J, Szmajduch M, Khan SU, Wang L, Chen D (2013b) Genetic-based solutions for independent batch scheduling in data grids. International conference on ECMS pp 504–510

  • Kou Lawrence T, George M (1977) Multidimensional bin packing algorithms. IBM J Res Dev 21(5):443–448

    Article  MathSciNet  MATH  Google Scholar 

  • Lim MY, Porterfield A, Fowler R (2010) Softpower: fine-grain power estimations using performance counters. In: Proceedings of the 19th ACM international symposium on high performance distributed computing. ACM, San Jose, California, pp 308–311

  • Lin C-C, Liu P, Wu J-J (2011) Energy-aware virtual machine dynamic provision and scheduling for cloud computing. In: Cloud computing (CLOUD), 2011 IEEE international conference on IEEE, pp 736–737

  • Maciel P, Callou G, Tavares E, Sousa E, Silva B et al (2011) Estimating reliability importance and total cost of acquisition for data center power infrastructures. In: Systems, man, and cybernetics (SMC), 2011 IEEE international conference on IEEE, pp 421–426

  • Mhedheb Y, Jrad F, Tao J, Zhao J, Kołodziej J, Streit A (2013) Load and thermal-aware vm scheduling on the cloud. In: Algorithms and architectures for parallel processing. Springer, New York, pp 101–114

  • Mohsen S, Hadi S, Mahsa N (2012) Power-efficient distributed scheduling of virtual machines using workload-aware consolidation techniques. J Supercomput 61(1):46–66

    Article  Google Scholar 

  • Molnar E, Kryvinska N, Greguš M, (2014) Customer driven big-data analytics for the companies’ servitization. In: Baines T, Clegg B, Harrison D (eds) The spring servitization conference 2014 (SSC 2014), 12–14 May 2014, Aston Business School, Aston University, UK, pp 133–140

  • Negru C, Mocanu M, Cristea V, (2015a) Impact of virtual machines heterogeneity on data center power consumption in data-intensive applications. In adaptive resource management and scheduling for cloud computing. Springer, New York, pp 91–102

  • Negru C, Mocanu M, Chiru C, Draghia A, Drobot R (2015b) Cost efficient cloud-based service oriented architecture for water pollution prediction. In: Intelligent computer communication and processing (ICCP), 2015 IEEE international conference on IEEE, pp 417–423

  • Pallipadi V (2009) Enhanced intel speedstep technology and demand-based switching on linux. Intel Developer Service

  • Panigrahy R, Talwar K, Uyeda L, Wieder U (2011) Heuristics for vector bin packing. research. microsoft. com

  • Peng X, Zhigang H, Dongbo L, Guofeng Y, Xilong Q (2013) Virtual machine power measuring technique with bounded error in cloud environments. J Netw Comput Appl 36(2):818–828

  • Pillai P, Shin KG (2001) Real-time dynamic voltage scaling for low-power embedded operating systems. In: ACM SIGOPS operating systems review, vol 35. ACM, New York, pp 89–102

  • Prekas G, Primorac M, Belay A, Kozyrakis C, Bugnion E (2015) Energy proportionality and workload consolidation for latency-critical applications. In: Proceedings of the sixth ACM symposium on cloud computing. ACM, New York, pp 342–355

  • Ramon B, Yolanda B, David C, Vicenç B, Marc G, Xavier M, Nacho N, Jordi T, Eduard A (2012) Energy accounting for shared virtualized environments under dvfs using pmc-based power models. Futur Gener Comput Syst 28(2):457–468

    Article  Google Scholar 

  • Roman K, Markus G, Natalia K, Andreas M, Christine S, Christian S (2013) Strategic management of disruptive technologies: a practical framework in the context of voice services and of computing towards the cloud. Int J Grid Utility Comput 4(1):47–59

    Article  Google Scholar 

  • Sfrent A, Pop F (2015) Asymptotic scheduling for many task computing in big data platforms. Inf Sci

  • Sotiriadis S, Bessis N, Antonopoulos N (2011) Towards inter-cloud schedulers: a survey of meta-scheduling approaches. In: P2P, parallel, grid, cloud and internet computing (3PGCIC), 2011 international conference on IEEE, pp 59–66

  • Sotiriadis S, Bessis N, Anjum A, Buyya R (2015) An inter-cloud meta-scheduling (icms) simulation framework: architecture and evaluation. IEEE Trans Serv Comput 99:1–1

  • Welker MW, OA Place (2015). AMD processor performance evaluation guide. Retrieved from http://support.amd.com/techdocs/30579_3_74.pdf

  • Yongqiang G, Haibing G, Zhengwei Q, Yang H, Liang L (2013) A multi-objective ant colony system algorithm for virtual machine placement in cloud computing. J Comput Syst Sci 79(8):1230–1242

    Article  MathSciNet  MATH  Google Scholar 

  • Zaharia M, Chowdhury M, Franklin MJ, Shenker S, Stoica I (2010) Spark: cluster computing with working sets. In: Proceedings of the 2nd USENIX conference on Hot topics in cloud computing (HotCloud’10). USENIX Association, Berkeley, CA, pp 10–10

  • Zaharia M, Das T, Li H, Hunter T, Shenker S, Stoica I (2013) Discretized streams: fault-tolerant streaming computation at scale. In: Proceedings of the twenty-fourth ACM symposium on operating systems principles (SOSP ’13). ACM, New York, pp 423–438

Download references

Acknowledgments

The work has been funded by the projects: DataWay: Real-time Data Processing Platform for Smart Cities: Making sense of Big Data, PN-II-RU-TE-2014-4-2731; CyberWater grant of the Romanian National Authority for Scientific Research, CNDI-UEFISCDI, project number 47/2012.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Stelios Sotiriadis.

Ethics declarations

Conflict of interest

The authors of this paper Catalin Negru, Mariana Mocanu, Valentin Cristea, Stelios Sotiriadis and Nik Bessis declare that they have no conflict of interest.

Human and animal rights

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Communicated by F. Pop, C. Dobre and A. Costan.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Negru, C., Mocanu, M., Cristea, V. et al. Analysis of power consumption in heterogeneous virtual machine environments. Soft Comput 21, 4531–4542 (2017). https://doi.org/10.1007/s00500-016-2129-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-016-2129-7

Keywords

Navigation