Abstract
With the introduction of NoSQL databases the new opportunities in the field of cloud technology like scalability and performance were utilized. In fact not NoSQL databases could not satisfy all requirements towards some applications like consistency and ACID transactions. For this reason NewSQL databases were developed - a mixture of relational databases and NoSQL databases with the aim to get the advantages of both. Besides, presenting the most known NewSQL databases and the requirements of transformation tools, the most popular transformation tools in the field of NewSQL databases were introduced. An analysis shows how the comply with the requirements.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Anslett, M.: Nosql, newsql and beyond: the drivers and use cases for database alternatives. In: The Drivers and Use Cases for Database Alternatives, NoSQL, NewSQL and Beyond (2011)
Aslett, M.: How will the database incumbents respond to NoSQL and NewSQL (2011)
Atriwal, L., Nagar, P., Tayal, S., Gupta, V.: Business intelligence tools for big data. J. Basic Appl. Eng. Res. 3(6), 505–509 (2016)
Authors, V.: The vitess documentation. https://vitess.io/docs/
Belyy, A., et al.: Dataset previews for ETL transforms, 28 May 2013. US Patent 8,452,723
Bergamaschi, S., Guerra, F., Orsini, M., Sartori, C., Vincini, M.: A semantic approach to ETL technologies. Data Knowl. Eng. 70(8), 717–731 (2011)
Bhide, M.A., Bonagiri, K.K., Mittapalli, S.K.: Column based data transfer in extract transform and load (ETL) systems, 20 August 2013. US Patent 8,515,898
Biplob, M.B., Sheraji, G.A., Khan, S.I.: Comparison of different extraction transformation and loading tools for data warehousing. In: 2018 International Conference on Innovations in Science, Engineering and Technology (ICISET), pp. 262–267. IEEE (2018)
Buyya, R., Yeo, C.S., Venugopal, S., Broberg, J., Brandic, I.: Cloud computing and emerging it platforms: vision, hype, and reality for delivering computing as the 5th utility. Future Gen. Comput. Syst. 25(6), 599–616 (2009)
Clarivate: Web of science. https://clarivate.com/webofsciencegroup/solutions/web-of-science/
Citus Data: Citus documentation. https://docs.citusdata.com/
Davenport, R.J.: ETL vs ELT: a subjective view. In: Insource Commercial Aspects of BI Whitepaper (2008)
El Akkaoui, Z., Zimanyi, E., Mazón, J.N., Trujillo, J.: A model-driven framework for ETL process development. In: DOLAP 2011: Proceedings of the ACM 14th International Workshop on Data Warehousing and OLAP, pp. 45–52 (2011)
Fatima, H., Wasnik, K.: Comparison of SQL, NoSQL and NewSQL databases for Internet of Things. In: 2016 IEEE Bombay Section Symposium (IBSS), pp. 1–6. IEEE (2016)
Gartner, I.: Magic quadrant research methodology (2020). https://www.gartner.com/en/research/methodologies/magic-quadrants-research
Geelan, J., et al.: Twenty-one experts define cloud computing. Cloud Comput. J. 4, 1–5 (2009)
Gilbert, S., Lynch, N.: Brewer’s conjecture and the feasibility of consistent, available, partition-tolerant web services. ACM SIGACT News 33(2), 51–59 (2002)
solidIT consulting & software development GmbH: Db-engines (2020). https://db-engines.com/
Grolinger, K., Higashino, W.A., Tiwari, A., Capretz, M.A.: Data management in cloud environments: NoSQL and NewSQL data stores. J. Cloud Comput. Adv. Syst. Appl. 2(1), 22 (2013)
Gurevich, Y.: Comparative survey of NoSQL/NewSQL DB systems. The Open University of Israel, Department of Mathematics and Computer Science (2015)
Haerder, T., Reuter, A.: Principles of transaction-oriented database recovery. ACM Comput. Surv. (CSUR) 15(4), 287–317 (1983)
Hajoui, O., Dehbi, R., Talea, M., Batouta, Z.I.: An advanced comparative study of the most promising NoSQL and NewSQL databases with a multi-criteria analysis method. J. Theoret. Appl. Inf. Technol. 81(3), 579 (2015)
HVR Integration Software: enterprise data integration software — HVR (2020). https://www.hvr-software.com/
Google Inc., Cloud spanner — google cloud (2020). https://cloud.google.com/spanner
Safe Software Inc.: Safe software — fme — data integration platform (2020). https://www.safe.com/
Informatica: Enterprise cloud data management — informatica deutschland (2020). https://www.informatica.com/de/
ISO: Ergonomische Anforderungen für Bürotätigkeiten mit Bildschirmgeräten - Teil 11: Anforderungen an die Gebrauchstauglichkeit - Leitsätze. Beuth Verlag, Berlin (1999)
ISO: Ergonomische Anforderungen für Bürotätigkeiten mit Bildschirmgeräten - Teil 1: Allgemeine Einführung (ISO 9241–1:1997) (enthält Änderung AMD 1:2001); Deutsche Fassung EN ISO 9241–1:1997 + A1:2001. Beuth Verlag, Berlin (2002)
Han, J., Haihong, E., Le, G., Du, J.: Survey on NoSQL database. In: 2011 6th International Conference on Pervasive Computing and Applications, pp. 363–366 (2011)
Katragadda, R., Tirumala, S.S., Nandigam, D.: ETL tools for data warehousing: an empirical study of open source talend studio versus microsoft ssis. In: Computing Conference Papers [147] (2015)
Kaur, K., Sachdeva, M.: Performance evaluation of NewSQL databases. In: 2017 International Conference on Inventive Systems and Control (ICISC), pp. 1–5. IEEE (2017)
Kherdekar, V.A., Metkewar, P.S.: A technical comprehensive survey of ETL tools. In: Advanced Engineering Research and Applications, p. 20 (2016)
Kumar, R., Gupta, N., Maharwal, H., Charu, S., Yadav, K.: Critical analysis of database management using NewSQL. Int. J. Comput. Sci. Mob. Comput. 3, 434–438 (2014)
Cockroach Labs: Cockroach labs, the company building cockroachdb (2020). https://cockroachlabs.com/
Leavitt, N.: Will NoSQL databases live up to their promise? Computer 43(2), 12–14 (2010)
Google LLC: about google scholar. https://scholar.google.com/intl/de/scholar/about.html
Hitachi Vantara LLC: Pentaho enterprise edition — hitachi vantara (2020). https://www.hitachivantara.com/
Mehra, K.K., Kumar, P., Choudhury, P., Lakkur, A.L., Samanta, S.: Extract, transform and load (ETL) system and method, 5 April 2017. US Patent 9,633,095
Mell, P., Grance, T., et al.: The NIST definition of cloud computing. NIST special publication 800–145 (2011)
Moniruzzaman, A.B.M.: NewSQL: towards next-generation scalable RDBMS for online transaction processing (OLTP) for big data management. Int. J. Database Theory Appl. 7 (2014)
NuoDB: Nuodb home — nuodb (2020). https://nuodb.com/
OutSystems: the state of application development: Is it ready for disruption? Technical report, Department of Computer Science, Michigan State University, OutSystems: Boston, MA, USA, September 2019
Richardson, C., Rymer, J.R.: New Development Platforms Emerge for Customer-Facing Applications. Forrester, Cambridge (2014)
Scowen, G., Regenbrecht, H.: Increased popularity through compliance with usability guidelines in e-learning web sites. Int. J. Inf. Technol. Web Eng. (IJITWE) 4(3), 38–57 (2009)
SingleStore, I.: Singlestore is the database of nowâ„¢ powering modern applications and analytical systems (2020). https://www.singlestore.com/
Song, X., Yan, X., Yang, L.: Design ETL metamodel based on UML profile. In: 2009 Second International Symposium on Knowledge Acquisition and Modeling, vol. 3, pp. 69–72. IEEE (2009)
Talend: Talend - a cloud data integration leader (modern etl) (2020). https://www.talend.com/
Theodorou, V., Abelló, A., Lehner, W.: Quality measures for ETL processes. In: International Conference on Data Warehousing and Knowledge Discovery, pp. 9–22. Springer (2014)
VoltDB I.: Home - voltdb (2020). https://www.voltdb.com/
Zaidi, E., Thoo, E., Heudecker, N., Menon, S., Thanaraj, R.: Gartner magic quadrant for data integration tools. Gartner Group (2020)
Zaidi, E., Thoo, E., Heudecker, N., Menon, S., Thanaraj, R.: Magic quadrant for data integration tools 2020 (2020)
Zamanian, K., Nesamoney, D.: Apparatus and method for performing data transformations in data warehousing, 15 January 2002. US Patent 6,339,775
Zhang, Q., Cheng, L., Boutaba, R.: Cloud computing: state-of-the-art and research challenges. J. Internet Serv. Appl. 1(1), 7–18 (2010)
Acknowledgments
This research was made possible by funding from the ICT-AGRI-FOOD 2020 Joint Call. This work was supported by a grant of the Romanian National Authority for Scientific Research and Innovation, CCCDI - UEFISCDI, project number COFUND-ICT-AGRI-FOOD-GOHYDRO 200/2020, within PNCDI III.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Hahn, S.M.L., Chereja, I., Matei, O. (2021). Analysis of Transformation Tools Applicable on NewSQL Databases. In: Silhavy, R. (eds) Software Engineering and Algorithms. CSOC 2021. Lecture Notes in Networks and Systems, vol 230. Springer, Cham. https://doi.org/10.1007/978-3-030-77442-4_16
Download citation
DOI: https://doi.org/10.1007/978-3-030-77442-4_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-77441-7
Online ISBN: 978-3-030-77442-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)