Abstract
Today’s DBMS are constantly upon large-scale workloads (e.g., internet) and require a reliable tool to benchmark them upon a similar workload. Usually, benchmarking tools simulate a multi-user workload within a single machine. However, this avoids large-scale benchmarking and also introduces deviations in the result. In this paper, we present a solution for benchmarking DBMS in a fully distributed manner. The solution is based on the TPC-C specification and aims to simulate large-scale workloads. We validate our solution through implementation and experimentation on three open-source DBMS. Through experimentation, we analyze the behavior of all systems and show how our solution is able to scale up the benchmark.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bitton, D., DeWitt, D.J., Turbyfill, C.: Benchmarking Database Systems A Systematic Approach. In: VLDB, pp. 8–19 (1983)
DeWitt, D.J., Levine, C.: Not just correct, but correct and fast: a look at one of Jim Gray’s contributions to database system performance. SIGMOD Record 37(2), 45–49 (2008)
DeWitt, D.J.: The Wisconsin Benchmark: Past, Present, and Future. The Benchmark Handbook (1993)
Datamation: A Measure of Transaction Processing Power, pp. 112–118 (1985)
Transactional Processing Process Council, http://www.tpc.org
Serlin, O.: The History of DebitCredit and the TPC. The Benchmark Handbook (1993)
TPC Benchmark C, http://www.tpc.org/tpcc
Llanos, D.R.: TPCC-UVA: An Open-Source TPC-C Implementation for Global Performance Measurement of Computer Systems. ACM SIGMOD Record 35(4), 6–15 (2006)
de Almeida, E.C.: Estudo de viabilidade de uma plataforma de baixo custo para data warehouse. UFPR, Master Thesis (2004).
Hibernate - Relational Persistence for Java and .NET, http://www.hibernate.org
The Java Persistence API - A Simpler Programming Model for Entity Persistence, http://java.sun.com/developer/technicalArticles/J2EE/jpa
JSR-000220 Enterprise JavaBeans 3.0, http://jcp.org/aboutJava/communityprocess/final/jsr220
IBM Smalltalk Tutorial, http://www.inf.ufsc.br/poo/smalltalk/ibm/tutorial/oop.html
PostgreSQL, http://www.postgresql.org
BenchmarkSQL, http://sourceforge.net/projects/benchmarksql
OSDL-DBT2, http://sourceforge.net/projects/osdldbt
TPC-C Result Highlights, http://www.tpc.org/tpcc/results/tpcc_result_detail.asp?id=107022701
MySQL, http://www.mysql.com
The Apache DB Project, http://db.apache.org/derby
JDBC Drivers, http://developers.sun.com/product/jdbc/drivers
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
de Lima, M.R., Sunyé, M.S., de Almeida, E.C., Direne, A.I. (2009). Distributed Benchmarking of Relational Database Systems. In: Li, Q., Feng, L., Pei, J., Wang, S.X., Zhou, X., Zhu, QM. (eds) Advances in Data and Web Management. APWeb WAIM 2009 2009. Lecture Notes in Computer Science, vol 5446. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-00672-2_49
Download citation
DOI: https://doi.org/10.1007/978-3-642-00672-2_49
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-00671-5
Online ISBN: 978-3-642-00672-2
eBook Packages: Computer ScienceComputer Science (R0)