Abstract
TPC-VMS is a benchmark designed to measure the performance of virtualized databases using existing, time-tested TPC workloads. In this paper, we will present our experience in using the TPC-E workload under the TPC-VMS rules to measure the performance of 3 OLTP databases consolidated onto a single server. We will describe the tuning steps employed to more than double the performance and reach 98.6 % of the performance of a non-virtualized server – if we aggregate the throughputs of the 3 VMs for quantifying the tuning process. The paper will detail lessons learned in optimizing performance by tuning the application, the database manager, the guest operating system, the hypervisor, and the hardware on both AMD and Intel processors.
Since TPC-E results have been disclosed with non-virtualized databases on both platforms, we can analyze the performance overheads of virtualization for database workloads. With a native-virtual performance gap of just a few percentage points, we will show that virtualized servers make excellent platforms for the most demanding database workloads.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
VSUT is a term coined by the TPC-VMS benchmark, and is formally defined in the TPC-VMS specification [13]. In our case, it includes the Consolidated Database Server plus the client systems required by the TPC-E specification.
- 2.
As of 6/13/2014. Complete details available at http://www.tpc.org/4064.
- 3.
As of 6/13/2014. Complete details available at http://www.tpc.org/5201.
- 4.
As of 6/13/2014. Complete details available at http://www.tpc.org/4065.
- 5.
As of 6/13/2014. Complete details available at http://www.tpc.org/4066.
- 6.
As of 6/13/2014. Complete details available at http://www.tpc.org/5202.
References
Bhargava, R., Serebrin, B., Spanini, F., Manne, S.: Accelerating two-dimensional page walks for virtualized systems. In: Proceedings of the 13th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), March 2008
Bhatia, N.: Performance evaluation of intel EPT hardware assist. http://www.vmware.com/pdf/Perf_ESX_Intel-EPT-eval.pdf
Bond, A., Johnson, D., Kopczynski, G., Taheri, H.: Architecture and performance characteristics of a PostgreSQL implementation of the TPC-E and TPC-V workloads. In: Nambiar, R., Poess, M. (eds.) TPCTC 2013. LNCS, vol. 8391, pp. 77–92. Springer, Heidelberg (2014). ISBN 978-3-319-04935-9
Buell, J., et al.: Methodology for performance analysis of VMware vSphere under Tier-1 applications. VMware Tech. J. Summer 2013
IDC: Worldwide Virtual Machine 2013–2017 Forecast: Virtualization Buildout Continues Strong. http://www.idc.com/getdoc.jsp?containerId=242762
Intel 64 and IA-32 Architectures Developer’s Manual
Smith, W.D., Sebastian, S.: Virtualization Performance Insights from TPC-VMS. http://www.tpc.org/tpcvms/tpc-vms-2013-1.0.pdf
SPECvirt_sc2013 benchmark info, SPEC Virtualization Committee. http://www.spec.org/virt_sc2013/
TPC: Detailed TPC-C description. http://www.tpc.org/tpcc/detail.asp
TPC: Detailed TPC-E Description. http://www.tpc.org/tpce/spec/TPCEDetailed.doc
TPC: TPC Benchmark H Specification. http://www.tpc.org/tpch/spec/tpch2.14.4.pdf
TPC: TPC Benchmark DS Specification. http://www.tpc.org/tpcds/spec/tpcds_1.1.0.pdf
TPC: TPC-VMS benchmark. http://www.tpc.org/tpcvms/default.asp
VMware, Inc.: VMmark 2.x. http://www.vmware.com/products/vmmark/overview.html
VMware, Inc.: Performance Characteristics of VMFS and RDM. http://www.vmware.com/files/pdf/vmfs_rdm_perf.pdf
VMware, Inc.: The Architecture of VMware ESXi. http://www.vmware.com/files/pdf/ESXi_architecture.pdf
Acknowledgements
We would like to thank the TPC for making the TPC-VMS benchmark available, and the following individuals for their contribution to the benchmark results: Bao Chun-Jie, Seongbeom Kim, Paul Cao, Juan Garcia-Rovetta, Bruce Herndon, and Chethan Kumar.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Deehr, E., Fang, WQ., Reza Taheri, H., Yun, HF. (2015). Performance Analysis of Database Virtualization with the TPC-VMS Benchmark. In: Nambiar, R., Poess, M. (eds) Performance Characterization and Benchmarking. Traditional to Big Data. TPCTC 2014. Lecture Notes in Computer Science(), vol 8904. Springer, Cham. https://doi.org/10.1007/978-3-319-15350-6_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-15350-6_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-15349-0
Online ISBN: 978-3-319-15350-6
eBook Packages: Computer ScienceComputer Science (R0)