Abstract
Internet of Things (IoT) is continually expanding, and the information being transmitted through IoT is often in large-scale in both volume and velocity. With its evolution, IoT raises new challenges such as throughput and scalability of software and database working with it. This is the reason that traditional techniques for data management and database operations cannot adopt the new challenges from IoT data. We need an efficient database system that can handle, store, and retrieve continuous, high-speed, and large-volume data, perform various database operations, and generate quick results. Recent developments of database technologies such as NoSQL and NewSQL database provides promising solutions to IoT. This paper proposes an extensible cloud-based open-source benchmarking framework on how these databases could work with IoT data. Using the framework, we compare the performances of VoltDB NewSQL and MongoDB NoSQL database systems on IoT data injection, transactional operations, and analytical operations.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Beyer, M.A., Laney, D.: The Importance of ‘Big Data’: A Definition. Gartner, Stamford (2012)
Li, Y., Manoharan, S.: A performance comparison of SQL and NoSQL databases. In: Proceedings of 2013 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PACRIM), pp. 15–19. IEEE (2013)
Stonebraker, M., Madden, S., Abadi, D.J., Harizopoulos, S., Hachem, N., Helland, P.: The end of an architectural era: (it’s time for a complete rewrite). In: Proceedings of the 33rd International Conference on Very Large Data Bases, pp. 1150–1160. VLDB Endowment (2007)
Guy, H.: Next Generation Databases: NoSQL, NewSQL, and Big Data. Apress, New York City (2015)
MongoDB. https://www.mongodb.com/what-is-mongodb. Accessed 14 Feb 2019
VoltDB. https://docs.voltdb.com/UsingVoltDB/. Accessed 14 Feb 2019
Apache Kafka. https://kafka.apache.org/intro. Accessed 14 Feb 2019
Kafka. https://www.confluent.io/what-is-apache-kafka/. Accessed 14 Feb 2019
Cloud Computing. https://www.ibm.com/cloud/learn/what-is-cloud-computing. Accessed 14 Feb 2019
Database Sharding. http://www.agildata.com/database-sharding. Accessed 14 Feb 2019
Database Cluster,. https://www.postgresql.org/docs/9.0/static/creating-cluster.html. Accessed 14 Feb 2019
Apache Kafka Producer API. https://kafka.apache.org/0110/javadoc/index.html?org/apache/kafka/clients/producer/KafkaProducer.html. Accessed 14 Feb 2019
Java Random Class. https://docs.oracle.com/javase/8/docs/api/java/util/Random.html. Accessed 14 Feb 2019
Apache Kafka Consumer API. https://kafka.apache.org/0100/javadoc/index.html?org/apache/kafka/clients/consumer/KafkaConsumer.html. Accessed 14 Feb 2019
Hecht, R., Jablonski, S.: NoSQL evaluation: a use case oriented survey. In: 2011 International Conference on Cloud and Service Computing (CSC), pp. 336–341. IEEE (2011)
Haleemunnisa, F., Wasnik, K.: Comparison of SQL, NoSQL and NewSQL databases for Internet of Things. In: Bombay Section Symposium (IBSS), pp. 1–6. IEEE (2016)
Kaur, K., Sachdeva, M.: Performance evaluation of NewSQL databases. In: 2017 International Conference on Inventive Systems and Control (ICISC), pp. 1–5. IEEE (2017)
Open Source IoT Database Benchmarking Framework. https://github.com/big-data-lab-umbc/IoT-database-benchmarking. Accessed 14 Feb 2019
Acknowledgment
This work is supported in part by the National Natural Science Foundation of China (No. 61462076).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Pandya, A., Kulkarni, C., Mali, K., Wang, J. (2019). An Open Source Cloud-Based NoSQL and NewSQL Database Benchmarking Platform for IoT Data. In: Zheng, C., Zhan, J. (eds) Benchmarking, Measuring, and Optimizing. Bench 2018. Lecture Notes in Computer Science(), vol 11459. Springer, Cham. https://doi.org/10.1007/978-3-030-32813-9_7
Download citation
DOI: https://doi.org/10.1007/978-3-030-32813-9_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32812-2
Online ISBN: 978-3-030-32813-9
eBook Packages: Computer ScienceComputer Science (R0)