Skip to main content
SpringerLink
Log in

An efficient virtual CPU scheduling in cloud computing

  • Focus
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

In cloud computing, fine-grained virtual CPU scheduling techniques are essential in hiding physical resources from running applications and mitigating the decrease in performance upon virtualization. However, evaluating and predicting the behaviors of virtual processors is getting harder because of the diverse QoS requirements of cloud applications. In this paper, we propose a novel virtual CPU scheduling scheme to provide a high I/O performance for cloud applications. We present an evaluation function that evaluates the task characteristics of virtual machines by observing the amount of resource consumption of each virtual processor. Based on the evaluation function, the proposed scheduling scheme controls the priorities of virtual machines adaptively for fair distribution in handling I/O requests. Because our scheme evaluates both CPU-intensiveness and I/O-intensiveness of virtual machines, it provides high performance in terms of responsiveness even for various types of tasks. We implemented and experimented the proposed scheme on a virtual machine monitor. The experimental results showed that the proposed scheme increases the responsiveness and I/O bandwidth of virtual machines.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Bai Y, Xu C, Li Z (2010) Task-aware based co-scheduling for virtual machine system. In: Proceedings of the 2010 ACM symposium on applied computing, SAC 2010, Sierre, Switzerland, March 22–26, 2010. ACM, pp 181–188

  • Barham P, Dragovic B, Fraser K, Hand S, Harris T, Ho A, Neugebauer R, Pratt I, Warfield A (2003) Xen and the art of virtualization. In: Proceedings of the nineteenth ACM symposium on operating systems principles, SOSP 2003, Bolton Landing, NY, USA, October 19–22, 2003. ACM, pp 164–177

  • Beloglazov A, Buyya R (2010) Energy efficient resource management in virtualized cloud data centers. In: Proceedings of the 2010 10th IEEE/ACM international conference on cluster, cloud and grid computing, CCGRID 2010, Washington, DC, USA, May 17–20, 2010. IEEE Computer Society, pp 826–831

  • Chen H, Jin H, Hu K, Yuan M (2010) Adaptive Audio-aware Scheduling in Xen virtual environment. In: Proceedings of ACS/IEEE international conference on computer systems and applications, AICCSA 2010, Tunisia, May 16–19, 2010. IEEE, pp 1–8

  • Cherkasova L, Gardner R (2005) Measuring CPU Overhead for I/O processing in the Xen virtual machine monitor. In: Proceedings of the 2005 USENIX annual technical conference, Anaheim, CA, April 10–15, 2005, USENIX, pp 387–390

  • Ding X, Ma Z, Da X (2014) Dynamic time slice of credit scheduler, In: Proceedings of IEEE international conference on information and automation, ICIA 2014, Hailar, China, July 28–30, 2014. IEEE, pp 654–659

  • Gordon A, Amit N, Har’El N, Ben-Yehuda M, Landau A, Schuster A, Tsafrir D (2012) ELI: bare-metal performance for I/O virtualization. In Proceedings of the seventeenth international conference on architectural support for programming languages and operating systems, ASPLOS XVII, London, England, UK, March 03–07, 2012. ACM, pp 411–422

  • Hassan HA, Kashkoush MS, Azab M, Sheta WM (2019) Impact of using multi-levels of parallelism on HPC applications performance hosted on Azure cloud computing. Int J High Perform Comput Netw 13(3):251–260

    Article  Google Scholar 

  • Iosup A, Ostermann S, Yigitbasi MN, Prodan R, Fahringer T, Epema D (2011) Performance analysis of cloud computing services for many-tasks scientific computing. IEEE Trans Parallel Distrib Syst 22(6):931–948

    Article  Google Scholar 

  • Jain R, Paul S (2013) Network virtualization and software defined networking for cloud computing: a survey. IEEE Commun Mag 51(11):24–31

    Article  Google Scholar 

  • Kim D, Kim H, Jeon M, Seo E, Lee J (2008) Guest-aware priority-based virtual machine scheduling for highly consolidated server. In: Proceedings of European conference on parallel processing, Euro-Par 2008, Las Palmas de Gran Canaria, Spain, August 25–29, 2008. Springer, 2008, pp Canary Island, Spain, pp 285–294

  • Kim H, Lim H, Jeong J, Jo H, Lee J (2009) Task-aware virtual machine scheduling for I/O performance. In: Proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environments, VEE 2009, Washington, DC, USA, March 11–13, 2009. ACM, pp 101–110

  • Kivity A, Kamay Y, Laor D, Lublin U, Liguori A (2007) KVM: the Linux virtual machine monitor. In: Proceedings of the linux symposium, pp 225–230

  • Manasrah AM, Aldomi A, Gupta BB (2019) An optimized service broker routing policy based on differential evolution algorithm in fog/cloud environment. Cluster Comput 22(1):1639–1653

    Article  Google Scholar 

  • Moreno-Vozmediano RM, Montero RS, Llorente IM (2012) IaaS cloud architecture: from virtualized datacenters to federated cloud infrastructures. Computer 45(12):65–72

    Article  Google Scholar 

  • Nagarajan AB, Mueller F, Engelmann C, Scott SL (2007) Proactive fault tolerance for HPC with Xen virtualization. In: Proceedings of the 21st annual international conference on supercomputing, ICS 2007, Seattle, Washington, DC, USA, June 17–21, 2007. ACM, pp 23–32

  • Ongaro D, Cox AL, Rixner S (2008) Scheduling I/O in virtual machine monitors. In: Proceedings of the fourth ACM SIGPLAN/SIGOPS international conference on virtual execution environments, VEE 2008, Seattle, WA, USA, March 05–07, 2008. ACM, pp 1–10

  • Qu H, Liu X, Xu H (2015) A workload-aware resources scheduling method for virtual machine. Int J Grid Distrib Comput 8(1):247–258

    Article  Google Scholar 

  • Ratten V (2015) Cloud computing technology innovation advances: a set of research propositions. Int J Cloud Appl Comput (IJCAC) 5(1):69–76

    Google Scholar 

  • Sadashiv N, Kumar SM Dilip (2018) Broker-based resource management in dynamic multi-cloud environment. Int J High Perform Comput Netw 12(1):94–109

    Article  Google Scholar 

  • Velte A, Velte T (2010) Microsoft virtualization with hyper-V. McGraw-Hill, New York

    Google Scholar 

  • Watson J (2008) VirtualBox: bits and bytes masquerading as machines. Linux J 166:2008

    Google Scholar 

  • Williams D, Jamjoom H, Weatherspoon H (2012) The Xen-Blanket: virtualize once, run everywhere. In: Proceedings of the 7th ACM European conference on computer systems, EuroSys 2012, Bern, Switzerland, April 10–13, 2012. ACM, pp 113–126

  • Xi S, Wilson J, Lu C, Gill C (2011) RT-Xen: towards real-time hypervisor scheduling in xen. In: Proceedings of the ninth ACM international conference on embedded software, EMSOFT 2011, Taipei, Taiwan, October 09–14, 2011. ACM, pp 39–48

  • Xu C, Gamage S, Rao PN, Kangarlou A, Kompella RR, Xu D (2012) vSlicer: latency-aware virtual machine scheduling via differentiated-frequency CPU slicing. In: Proceedings of the 21st international symposium on high-performance parallel and distributed computing, HPDC 2012, Delft, The Netherlands, June 18–22, 2012. ACM, pp 3–12

  • Yang C, Liu J, Huang K, Jiang F (2014) A method for managing green power of a virtual machine cluster in cloud. Future Gen Comput Syst 37:26–36

    Article  Google Scholar 

  • Zeng L, Wang Y, Feng D, Kent KB (2015) XCollOpts: a novel improvement of network virtualizations in Xen for I/O-latency sensitive applications on multicores. IEEE Trans Netw Serv Manag 12(2):163–175

    Article  Google Scholar 

  • Zkik K, Orhanou G, Hajji S (2017) Secure mobile multi cloud architecture for authentication and data storage. Int J Cloud Appl Comput (IJCAC) 7(2):62–76

    Google Scholar 

Download references

Acknowledgements

This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (NRF-2016R1D1A3B03931258). The authors certify that they have no affiliations with or involvement in any organization or entity with any financial interest or non-financial interest in the subject matter or materials discussed in this manuscript.

Author information

Author notes

  1. Joonhyouk Jang and Jinman Jung have contributed equally.

Authors and Affiliations

  1. USEED Inc., Siheung-si, Korea

    Joonhyouk Jang

  2. Hannam University, Daejeon, Korea

    Jinman Jung

  3. Soongsil University, Seoul, Korea

    Jiman Hong

Authors
  1. Joonhyouk Jang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jinman Jung
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jiman Hong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jiman Hong.

Ethics declarations

Conflict of interest

No potential conflict of interest was reported by the authors.

Additional information

Communicated by B. B. Gupta.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This paper is an extension version of the conference paper: A Virtual CPU Scheduling Model for I/O Performance in Paravirtualized Environments, J. Jung, J. Park, S. Kim, M. Heo, J. Hong, In Proceeding of the International Conference on Research in Adaptive and Convergent Systems, pp. 20–23. ACM.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jang, J., Jung, J. & Hong, J. An efficient virtual CPU scheduling in cloud computing. Soft Comput 24, 5987–5997 (2020). https://doi.org/10.1007/s00500-019-04551-w

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-019-04551-w

Keywords

Search

Navigation