Abstract
Reduction of energy consumption in Cloud computing datacenters today is a hot a research topic, as these consume large amounts of energy. Furthermore, most of the energy is used inefficiently because of the improper usage of computational resources such as CPU, storage and network. A good balance between the computing resources and performed workload is mandatory. In the context of data-intensive applications, a significant portion of energy is consumed just to keep alive virtual machines or to move data around without performing useful computation. Moreover, heterogeneity of resources increases the difficulty degree, when trying to achieve energy efficiency. Power consumption optimization requires identification of those inefficiencies in the underlying system and applications. Based on the relation between server load and energy consumption, we study the efficiency of data-intensive applications, and the penalties, in terms of power consumption, that are introduced by different degrees of heterogeneity of the virtual machines characteristics in a cluster.
Similar content being viewed by others
References
Andreas M, Natalia K, Christine S (2012) Towards cloud-centric service environments. J Serv Sci Res 4(2):213–234
Andreas B, Hermann D (2011) An energy consumption model for virtualized office environments. Futur Gener Comput Syst 27(8):1047–1055
Aroca JA, Anta AF, Mosteiro MA, Thraves C, Wang L (2016) Power-efficient assignment of virtual machines to physical machines. Futur Gener Comput Syst 54:82–94
Barroso LA, Clidaras J, Hölzle U (2013) The datacenter as a computer: An introduction to the design of warehouse-scale machines. Synth Lect Comput Archit 8(3):1–154
Bessis N, Sotiriadis S, Pop F, Cristea V (2012) Optimizing the energy efficiency of message exchanging for service distribution in interoperable infrastructures. In: Intelligent networking and collaborative systems (INCoS), 2012 4th international conference on IEEE, pp 105–112
Bessis N, Sotiriadis S, Pop F, Cristea V (2013) Using a novel message exchanging optimization (meo) model to reduce energy consumption in distributed systems. Simul Model Pract Theory 39:104–120
Bircher WL, John LK (2012) Complete system power estimation using processor performance events. Comput IEEE Trans 61(4):563–577
Bohra AEH, Chaudhary V (2010) Vmeter: power modelling for virtualized clouds. In: Parallel and distributed processing, workshops and Phd Forum (IPDPSW), 2010 IEEE International Symposium on IEEE, pp 1–8
Borthakur D (2008) Hdfs architecture guide. HADOOP APACHE PROJECT http://hadoop.apache.org/common/docs/current/hdfsdesign.pdf
Borthakur D, Gray J, Sarma JS, Muthukkaruppan K, Spiegelberg N, Kuang H, Ranganathan K, Molkov D, Menon A, Rash S et al (2011) Apache hadoop goes realtime at facebook. In: Proceedings of the 2011 ACM SIGMOD international conference on management of data ACM, pp 1071–1080
Christoph M, Waltenegus D, Alexander S (2014) Power consumption estimation models for processors, virtual machines, and servers. Parallel Distrib Syst IEEE Trans 25(6):1600–1614
Copeland M, Soh J, Puca A, Manning M, Gollob D (2015) Microsoft azure and cloud computing. In: Microsoft azure. Apress, New York, pp 3–26
Delforge P (2014) America’s data centers consuming and wasting growing amounts of energy. Natural Resource Defense Council. Retrieved from http://www.nrdc.org/energy/data-center-efficiency-assessment.asp
Demchenko Y, Grosso P, De Laat C, Membrey P (2013) Addressing big data issues in scientific data infrastructure. In: Collaboration technologies and systems (CTS), 2013 international conference on IEEE, pp 48–55
Dorigo M, Birattari M (2010) Ant colony optimization. In: Encyclopedia of machine learning. Springer, New York, pp 36–39
Enhanced Intel (2004) Speedstep technology for the intel pentium m processor. Retrieved from http://download.intel.com/design/network/papers/30117401.pdf
Ewa N-S, Andrzej S, Piotr A, Mariusz K, Marcin M, Joanna K (2014) Dynamic power management in energy-aware computer networks and data intensive computing systems. Futur Gener Comput Syst 37:284–296
Feller E, Rilling L, Morin C (2011) Energy-aware ant colony based workload placement in clouds. In: Proceedings of the 2011 IEEE/ACM 12th international conference on grid computing. IEEE Computer Society, USA, pp 26–33
Ficco M, Palmieri F (2015) Introducing fraudulent energy consumption in cloud infrastructures: a new generation of denial-of-service attacks. Syst J IEEE (99):1–11
Florin P, Ciprian D, Valentin C, Nik B, Fatos X, Leonard B (2015) Deadline scheduling for aperiodic tasks in inter-cloud environments: a new approach to resource management. J Supercomput 71(5):1754–1765
Ghit B, Capota M, Hegeman T, Hidders J, Epema D, Iosup A (2014) V for vicissitude: the challenge of scaling complex big data workflows. In: Cluster, cloud and grid computing (CCGrid), 2014 14th IEEE/ACM international symposium on IEEE, pp 927–932
Goudarzi H, Pedram M (2012) Energy-efficient virtual machine replication and placement in a cloud computing system. In: Cloud computing (CLOUD), 2012 IEEE 5th international conference on IEEE, pp 750–757
Iordache GV, Boboila MS, Pop F, Stratan C, Cristea V (2006) A decentralized strategy for genetic scheduling in heterogeneous environments. In: On the move to meaningful internet systems 2006: CoopIS, DOA, GADA, and ODBASE. Springer, New York, pp 1234–1251
Isard M, Budiu M, Yu Y, Birrell A, Fetterly D (2007) Dryad: distributed data-parallel programs from sequential building blocks. In: ACM SIGOPS operating systems review, vol 41. ACM, New York, pp 59–72
Jeffrey D, Sanjay G (2008) Mapreduce: simplified data processing on large clusters. Commun ACM 51(1):107–113
Khosravi A, Garg SK, Buyya R (2013) Energy and carbon-efficient placement of virtual machines in distributed cloud data centers. In: Euro-Par 2013 parallel processing. Springer, New York, pp 317–328
Kołodziej J, Khan SU, Xhafa F (2011) Genetic algorithms for energy-aware scheduling in computational grids. In: P2P, parallel, grid, cloud and internet computing (3PGCIC), 2011 international conference on IEEE, pp 17–24
KołOdziej J, Khan SU (2012) Multi-level hierarchic genetic-based scheduling of independent jobs in dynamic heterogeneous grid environment. Inf Sci 214:1–19
Kolodziej J, Szmajduch M, Maqsood T, Madani SA, Min-Allah N, Khan SU (2013a) Energy-aware grid scheduling of independent tasks and highly distributed data. In: Frontiers of information technology (FIT), 2013 11th international conference on IEEE, pp 211–216
Kolodziej J, Szmajduch M, Khan SU, Wang L, Chen D (2013b) Genetic-based solutions for independent batch scheduling in data grids. International conference on ECMS pp 504–510
Kou Lawrence T, George M (1977) Multidimensional bin packing algorithms. IBM J Res Dev 21(5):443–448
Lim MY, Porterfield A, Fowler R (2010) Softpower: fine-grain power estimations using performance counters. In: Proceedings of the 19th ACM international symposium on high performance distributed computing. ACM, San Jose, California, pp 308–311
Lin C-C, Liu P, Wu J-J (2011) Energy-aware virtual machine dynamic provision and scheduling for cloud computing. In: Cloud computing (CLOUD), 2011 IEEE international conference on IEEE, pp 736–737
Maciel P, Callou G, Tavares E, Sousa E, Silva B et al (2011) Estimating reliability importance and total cost of acquisition for data center power infrastructures. In: Systems, man, and cybernetics (SMC), 2011 IEEE international conference on IEEE, pp 421–426
Mhedheb Y, Jrad F, Tao J, Zhao J, Kołodziej J, Streit A (2013) Load and thermal-aware vm scheduling on the cloud. In: Algorithms and architectures for parallel processing. Springer, New York, pp 101–114
Mohsen S, Hadi S, Mahsa N (2012) Power-efficient distributed scheduling of virtual machines using workload-aware consolidation techniques. J Supercomput 61(1):46–66
Molnar E, Kryvinska N, Greguš M, (2014) Customer driven big-data analytics for the companies’ servitization. In: Baines T, Clegg B, Harrison D (eds) The spring servitization conference 2014 (SSC 2014), 12–14 May 2014, Aston Business School, Aston University, UK, pp 133–140
Negru C, Mocanu M, Cristea V, (2015a) Impact of virtual machines heterogeneity on data center power consumption in data-intensive applications. In adaptive resource management and scheduling for cloud computing. Springer, New York, pp 91–102
Negru C, Mocanu M, Chiru C, Draghia A, Drobot R (2015b) Cost efficient cloud-based service oriented architecture for water pollution prediction. In: Intelligent computer communication and processing (ICCP), 2015 IEEE international conference on IEEE, pp 417–423
Pallipadi V (2009) Enhanced intel speedstep technology and demand-based switching on linux. Intel Developer Service
Panigrahy R, Talwar K, Uyeda L, Wieder U (2011) Heuristics for vector bin packing. research. microsoft. com
Peng X, Zhigang H, Dongbo L, Guofeng Y, Xilong Q (2013) Virtual machine power measuring technique with bounded error in cloud environments. J Netw Comput Appl 36(2):818–828
Pillai P, Shin KG (2001) Real-time dynamic voltage scaling for low-power embedded operating systems. In: ACM SIGOPS operating systems review, vol 35. ACM, New York, pp 89–102
Prekas G, Primorac M, Belay A, Kozyrakis C, Bugnion E (2015) Energy proportionality and workload consolidation for latency-critical applications. In: Proceedings of the sixth ACM symposium on cloud computing. ACM, New York, pp 342–355
Ramon B, Yolanda B, David C, Vicenç B, Marc G, Xavier M, Nacho N, Jordi T, Eduard A (2012) Energy accounting for shared virtualized environments under dvfs using pmc-based power models. Futur Gener Comput Syst 28(2):457–468
Roman K, Markus G, Natalia K, Andreas M, Christine S, Christian S (2013) Strategic management of disruptive technologies: a practical framework in the context of voice services and of computing towards the cloud. Int J Grid Utility Comput 4(1):47–59
Sfrent A, Pop F (2015) Asymptotic scheduling for many task computing in big data platforms. Inf Sci
Sotiriadis S, Bessis N, Antonopoulos N (2011) Towards inter-cloud schedulers: a survey of meta-scheduling approaches. In: P2P, parallel, grid, cloud and internet computing (3PGCIC), 2011 international conference on IEEE, pp 59–66
Sotiriadis S, Bessis N, Anjum A, Buyya R (2015) An inter-cloud meta-scheduling (icms) simulation framework: architecture and evaluation. IEEE Trans Serv Comput 99:1–1
Welker MW, OA Place (2015). AMD processor performance evaluation guide. Retrieved from http://support.amd.com/techdocs/30579_3_74.pdf
Yongqiang G, Haibing G, Zhengwei Q, Yang H, Liang L (2013) A multi-objective ant colony system algorithm for virtual machine placement in cloud computing. J Comput Syst Sci 79(8):1230–1242
Zaharia M, Chowdhury M, Franklin MJ, Shenker S, Stoica I (2010) Spark: cluster computing with working sets. In: Proceedings of the 2nd USENIX conference on Hot topics in cloud computing (HotCloud’10). USENIX Association, Berkeley, CA, pp 10–10
Zaharia M, Das T, Li H, Hunter T, Shenker S, Stoica I (2013) Discretized streams: fault-tolerant streaming computation at scale. In: Proceedings of the twenty-fourth ACM symposium on operating systems principles (SOSP ’13). ACM, New York, pp 423–438
Acknowledgments
The work has been funded by the projects: DataWay: Real-time Data Processing Platform for Smart Cities: Making sense of Big Data, PN-II-RU-TE-2014-4-2731; CyberWater grant of the Romanian National Authority for Scientific Research, CNDI-UEFISCDI, project number 47/2012.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors of this paper Catalin Negru, Mariana Mocanu, Valentin Cristea, Stelios Sotiriadis and Nik Bessis declare that they have no conflict of interest.
Human and animal rights
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Communicated by F. Pop, C. Dobre and A. Costan.
Rights and permissions
About this article
Cite this article
Negru, C., Mocanu, M., Cristea, V. et al. Analysis of power consumption in heterogeneous virtual machine environments. Soft Comput 21, 4531–4542 (2017). https://doi.org/10.1007/s00500-016-2129-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-016-2129-7