Abstract
Cross-interference may happen when applications share a common physical machine, affecting negatively their performances. This problem occurs frequently when high performance applications are executed in clouds. Some papers of the related literature have considered this problem when proposing strategies for Virtual Machine Placement. However, they neither have employed a suitable method for predicting interference nor have considered the minimization of the number of used physical machines and interference at the same time. In this paper, we present a solution based on the Iterated Local Search framework to solve the Interference-aware Virtual Machine Placement Problem for HPC applications in Clouds (IVMP). This problem aims to minimize, at the same time, the interference suffered by HPC applications which share common physical machines and the number of physical machines used to allocate them. Experiments were conducted in a real scenario by using applications from oil and gas industry and applications from the HPCC benchmark. They showed that our method reduced interference in more than 40%, using the same number of physical machines of the most widely employed heuristics to solve the problem.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
In the context of this work, the amount of access to SLLC and DRAM are measured in terms of millions of references per second (MR/s), while the access to virtual network is expressed as the number of megabytes transmitted per second (MB/s).
References
Alves, M., Teylo, L., Frota, Y., Drummond, L.: An interference-aware virtual machine placement strategy for high performance computing applications in clouds. In: XIX Simpósio em Sistemas Computacionais de Alto Desempenho (WSCAD 2018), Brazil (2018)
Alves, M.M., de Assumpção Drummond, L.M.: A multivariate and quantitative model for predicting cross-application interference in virtual environments. J. Syst. Softw. 128, 150–163 (2017)
Basto, D.T.: Interference aware scheduling for cloud computing. Master’s thesis, Universidade do Porto (2015)
Chen, L., Patel, S., Shen, H., Zhou, Z.: Profiling and understanding virtualization overhead in cloud. In: 44th International Conference on Parallel Processing (ICPP), pp. 31–40. IEEE (2015)
Chen, L., Shen, H., Platt, S.: Cache contention aware virtual machine placement and migration in cloud datacenters. In: 24th International Conference on Network Protocols (ICNP), pp. 1–10. IEEE (2016)
El-Gazzar, R., Hustad, E., Olsen, D.H.: Understanding cloud computing adoption issues: a Delphi study approach. J. Syst. Softw. 118, 64–84 (2016)
Gupta, A., et al.: Evaluating and improving the performance and scheduling of HPC applications in cloud. IEEE Trans. Cloud Comput. 7161(c), 1 (2014)
Gupta, A., Kale, L.V., Milojicic, D., Faraboschi, P., Balle, S.M.: HPC-aware VM placement in infrastructure clouds. In: International Conference on Cloud Engineering (IC2E), pp. 11–20. IEEE (2013)
Jersak, L.C., Ferreto, T.: Performance-aware server consolidation with adjustable interference levels. In: Proceedings of the 31st Annual Symposium on Applied Computing, pp. 420–425. ACM (2016)
Jin, H., Qin, H., Wu, S., Guo, X.: CCAP: a cache contention-aware virtual machine placement approach for HPC cloud. Int. J. Parallel Program. 43(3), 403–420 (2015)
Melo Alves, M., da Cruz Pestana, R., Alves Prado da Silva, R., Drummond, L.M.A.: Accelerating pre-stack Kirchhoff time migration by manual vectorization. Concurr. Comput.: Pract. Exp. 29(22), 1–20 (2017)
Netto, M.A., Calheiros, R.N., Rodrigues, E.R., Cunha, R.L., Buyya, R.: HPC cloud for scientific and business applications: taxonomy, vision, and research challenges. ACM Comput. Surv. 1(1) (2017)
Otto, C., Kempka, T.: Prediction of steam jacket dynamics and water balances in underground coal gasification. Energies 10(6), 739 (2017)
Pires, F.L., Barán, B.: A virtual machine placement taxonomy. In: 15th International Symposium on Cluster, Cloud and Grid Computing (CCGrid), pp. 159–168. IEEE/ACM (2015)
Tsuruoka, Y.: Cloud computing-current status and future directions. J. Inf. Process. 24(2), 183–194 (2016)
Yokoyama, D., Schulze, B., Kloh, H., Bandini, M., Rebello, V.: Affinity aware scheduling model of cluster nodes in private clouds. J. Netw. Comput. Appl. 95, 94–104 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Alves, M.M., Teylo, L., Frota, Y., Drummond, L.M.d.A. (2020). An Interference-Aware Strategy for Co-locating High Performance Computing Applications in Clouds. In: Bianchini, C., Osthoff, C., Souza, P., Ferreira, R. (eds) High Performance Computing Systems. WSCAD 2018. Communications in Computer and Information Science, vol 1171. Springer, Cham. https://doi.org/10.1007/978-3-030-41050-6_1
Download citation
DOI: https://doi.org/10.1007/978-3-030-41050-6_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-41049-0
Online ISBN: 978-3-030-41050-6
eBook Packages: Computer ScienceComputer Science (R0)