Jon Whiteaker
Renata Teixeira
Abstract
This paper performs controlled experiments with two popular virtualization techniques, Linux-VServer and Xen, to examine the effects of virtualization on packet sending and receiving delays. Using a controlled setting allows us to independently investigate the influence on delay measurements when competing virtual machines (VMs) perform tasks that consume CPU, memory, I/O, hard disk, and network bandwidth. Our results indicate that heavy network usage from competing VMs can introduce delays as high as 100 ms to round-trip times. Furthermore, virtualization adds most of this delay when sending packets, whereas packet reception introduces little extra delay. Based on our findings, we discuss guidelines and propose a feedback mechanism to avoid measurement bias under virtualization.
- Amazon ec2. http://aws.amazon.com/ec2/.Google Scholar
- Amazon web services: Overview of security processes. Tech. rep., Amazon, 2008.Google Scholar
- BARHAM, P., DRAGOVIC, B., FRASER, K., HAND, S., HARRIS, T., HO, A., NEUGEBAUER, R., PRATT, I., AND WARFIELD, A. Xen and the art of virtualization. In Proc. SOSP '03 (2003), pp. 164--177. Google ScholarDigital Library
- CAMARGOS, F. L., GIRARD, G., AND LIGNERIS, B. D. Virtualization of linux servers: A comparative study. In Proc. 2008 Linux Symposium (2008), vol. 1, pp. 63--76.Google Scholar
- CHUN, B., CULLER, D., ROSCOE, T., BAVIER, A., PETERSON, L., WAWRZONIAK, M., AND BOWMAN, M. Planetlab: an overlay testbed for broad-coverage services. ACM SIGCOMM Computer Communication Review 33, 3 (2003), 3--12. Google ScholarDigital Library
- Debian. http://www.debian.org/.Google Scholar
- EGI, N., GREENHALGH, A., HANDLEY, M., HOERDT, M., MATHY, L., AND SCHOOLEY, T. Evaluating xen for router virtualization. In Proc. ICCCN (2007), pp. 1256--1261.Google ScholarCross Ref
- ENDACE MEASUREMENT SYSTEMS. http://www.endace.com/.Google Scholar
- Grenouille. http://www.grenouille.com/.Google Scholar
- GUPTA, D., CHERKASOVA, L., GARDNER, R., AND VAHDAT, A. Enforcing performance isolation across virtual machines in xen. In Proc. Middleware '06 (2006), pp. 342--362. Google ScholarDigital Library
- HUANG, M. Vnet: Planetlab virtualized network access. Tech. Rep. PDN-05-029, PlanetLab Document, 2005.Google Scholar
- KOLYSHKIN, K. Virtualization in linux. Tech. rep. 2006.Google Scholar
- LEE, S.-J., SHARMA, P., BANERJEE, S., BASU, S., AND FONSECA, R. Measuring bandwidth between planetlab nodes. In Proc. PAM (2005), vol. 3431. Google ScholarDigital Library
- Linux-vserver. http://linux-vserver.org/.Google Scholar
- Measurement lab (m-lab). http://www.measurementlab.net/.Google Scholar
- MENON, A., COX, A. L., AND ZWAENEPOEL, W. Optimizing network virtualization in xen. In Proc. USENIX ATC (2006), pp. 15--28. Google ScholarDigital Library
- Nanodatacenters. http://www.nanodatacenters.eu/.Google Scholar
- NLANR. Iperf. http://iperf.sourceforge.net/.Google Scholar
- ONGARO, D., COX, A. L., AND RIXNER, S. Scheduling i/o in virtual machine monitors. In Proc. VEE '08 (New York, NY, USA, 2008), ACM, pp. 1--10. Google ScholarDigital Library
- Open vswitch. http://openvswitch.org/Google Scholar
- Openvz. http://www.openvz.org/.Google Scholar
- PADALA, P., ZHU, X., WANG, Z., SINGHAL, S., AND SHIN, K. G. Performance evaluation of virtualization technologies for server consolidation. Tech. Rep. HPL-2007-59, HP Laboratories Technical Report, 2007.Google Scholar
- PARK, K., AND PAI, V. S. Comon: a mostly-scalable monitoring system for planetlab. ACM SIGOPS Operating Systems Review 40, 1 (2006), 65--74. Google ScholarDigital Library
- PFAFF, B., PETTIT, J., KOPONEN, T., AMIDON, K., CASADO, M., AND SHENKER, S. Extending networking into the virtualization layer. In Proc. of workshop on Hot Topics in Networks (HotNets-VIII) (Oct 2009).Google Scholar
- Planet-lab. http://www.planet-lab.org/.Google Scholar
- SOLTESZ, S., PÖTZL, H., FIUCZYNSKI, M. E., BAVIER, A., AND PETERSON, L. Container-based operating system virtualization: a scalable, high-performance alternative to hypervisors. ACM SIGOPS Operating Systems Review 41, 3 (2007), 275--287. Google ScholarDigital Library
- SOMMERS, J., AND BARFORD, P. An active measurement system for shared environments. In Proc. IMC'07 (2007), pp. 303--314. Google ScholarDigital Library
- SPRING, N., PETERSON, L., BAVIER, A., AND PAI, V. Using planetlab for network research: myths, realities, and best practices. ACM SIGOPS Operating Systems Review 40, 1 (2006), 17--24. Google ScholarDigital Library
- WANG, G., AND NG, T. S. E. The impact of virtualization on network performance of amazon EC2 data center. In INFOCOM (2010). Google ScholarDigital Library
- WATERLAND, A. stress. http://weather.ou.edu/Üapw/projects/stress/.Google Scholar
- Xen. http://www.xen.org/.Google Scholar
Index Terms
- Explaining packet delays under virtualization
Recommendations
High performance network virtualization with SR-IOV
Virtualization poses new challenges to I/O performance. The single-root I/O virtualization (SR-IOV) standard allows an I/O device to be shared by multiple Virtual Machines (VMs), without losing performance. We propose a generic virtualization ...
Transparently bridging semantic gap in CPU management for virtualized environments
Consolidated environments are progressively accommodating diverse and unpredictable workloads in conjunction with virtual desktop infrastructure and cloud computing. Unpredictable workloads, however, aggravate the semantic gap between the virtual ...
Container-based operating system virtualization: a scalable, high-performance alternative to hypervisors
EuroSys '07: Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007Hypervisors, popularized by Xen and VMware, are quickly becoming commodity. They are appropriate for many usage scenarios, but there are scenarios that require system virtualization with high degrees of both isolation and efficiency. Examples include ...
Comments