Skip to main content

Analysis of Transformation Tools Applicable on NewSQL Databases

  • Conference paper
  • First Online:
Software Engineering and Algorithms (CSOC 2021)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 230))

Included in the following conference series:

Abstract

With the introduction of NoSQL databases the new opportunities in the field of cloud technology like scalability and performance were utilized. In fact not NoSQL databases could not satisfy all requirements towards some applications like consistency and ACID transactions. For this reason NewSQL databases were developed - a mixture of relational databases and NoSQL databases with the aim to get the advantages of both. Besides, presenting the most known NewSQL databases and the requirements of transformation tools, the most popular transformation tools in the field of NewSQL databases were introduced. An analysis shows how the comply with the requirements.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Anslett, M.: Nosql, newsql and beyond: the drivers and use cases for database alternatives. In: The Drivers and Use Cases for Database Alternatives, NoSQL, NewSQL and Beyond (2011)

    Google Scholar 

  2. Aslett, M.: How will the database incumbents respond to NoSQL and NewSQL (2011)

    Google Scholar 

  3. Atriwal, L., Nagar, P., Tayal, S., Gupta, V.: Business intelligence tools for big data. J. Basic Appl. Eng. Res. 3(6), 505–509 (2016)

    Google Scholar 

  4. Authors, V.: The vitess documentation. https://vitess.io/docs/

  5. Belyy, A., et al.: Dataset previews for ETL transforms, 28 May 2013. US Patent 8,452,723

    Google Scholar 

  6. Bergamaschi, S., Guerra, F., Orsini, M., Sartori, C., Vincini, M.: A semantic approach to ETL technologies. Data Knowl. Eng. 70(8), 717–731 (2011)

    Article  Google Scholar 

  7. Bhide, M.A., Bonagiri, K.K., Mittapalli, S.K.: Column based data transfer in extract transform and load (ETL) systems, 20 August 2013. US Patent 8,515,898

    Google Scholar 

  8. Biplob, M.B., Sheraji, G.A., Khan, S.I.: Comparison of different extraction transformation and loading tools for data warehousing. In: 2018 International Conference on Innovations in Science, Engineering and Technology (ICISET), pp. 262–267. IEEE (2018)

    Google Scholar 

  9. Buyya, R., Yeo, C.S., Venugopal, S., Broberg, J., Brandic, I.: Cloud computing and emerging it platforms: vision, hype, and reality for delivering computing as the 5th utility. Future Gen. Comput. Syst. 25(6), 599–616 (2009)

    Article  Google Scholar 

  10. Clarivate: Web of science. https://clarivate.com/webofsciencegroup/solutions/web-of-science/

  11. Citus Data: Citus documentation. https://docs.citusdata.com/

  12. Davenport, R.J.: ETL vs ELT: a subjective view. In: Insource Commercial Aspects of BI Whitepaper (2008)

    Google Scholar 

  13. El Akkaoui, Z., Zimanyi, E., Mazón, J.N., Trujillo, J.: A model-driven framework for ETL process development. In: DOLAP 2011: Proceedings of the ACM 14th International Workshop on Data Warehousing and OLAP, pp. 45–52 (2011)

    Google Scholar 

  14. Fatima, H., Wasnik, K.: Comparison of SQL, NoSQL and NewSQL databases for Internet of Things. In: 2016 IEEE Bombay Section Symposium (IBSS), pp. 1–6. IEEE (2016)

    Google Scholar 

  15. Gartner, I.: Magic quadrant research methodology (2020). https://www.gartner.com/en/research/methodologies/magic-quadrants-research

  16. Geelan, J., et al.: Twenty-one experts define cloud computing. Cloud Comput. J. 4, 1–5 (2009)

    Google Scholar 

  17. Gilbert, S., Lynch, N.: Brewer’s conjecture and the feasibility of consistent, available, partition-tolerant web services. ACM SIGACT News 33(2), 51–59 (2002)

    Article  Google Scholar 

  18. solidIT consulting & software development GmbH: Db-engines (2020). https://db-engines.com/

  19. Grolinger, K., Higashino, W.A., Tiwari, A., Capretz, M.A.: Data management in cloud environments: NoSQL and NewSQL data stores. J. Cloud Comput. Adv. Syst. Appl. 2(1), 22 (2013)

    Article  Google Scholar 

  20. Gurevich, Y.: Comparative survey of NoSQL/NewSQL DB systems. The Open University of Israel, Department of Mathematics and Computer Science (2015)

    Google Scholar 

  21. Haerder, T., Reuter, A.: Principles of transaction-oriented database recovery. ACM Comput. Surv. (CSUR) 15(4), 287–317 (1983)

    Article  MathSciNet  Google Scholar 

  22. Hajoui, O., Dehbi, R., Talea, M., Batouta, Z.I.: An advanced comparative study of the most promising NoSQL and NewSQL databases with a multi-criteria analysis method. J. Theoret. Appl. Inf. Technol. 81(3), 579 (2015)

    Google Scholar 

  23. HVR Integration Software: enterprise data integration software — HVR (2020). https://www.hvr-software.com/

  24. Google Inc., Cloud spanner — google cloud (2020). https://cloud.google.com/spanner

  25. Safe Software Inc.: Safe software — fme — data integration platform (2020). https://www.safe.com/

  26. Informatica: Enterprise cloud data management — informatica deutschland (2020). https://www.informatica.com/de/

  27. ISO: Ergonomische Anforderungen für Bürotätigkeiten mit Bildschirmgeräten - Teil 11: Anforderungen an die Gebrauchstauglichkeit - Leitsätze. Beuth Verlag, Berlin (1999)

    Google Scholar 

  28. ISO: Ergonomische Anforderungen für Bürotätigkeiten mit Bildschirmgeräten - Teil 1: Allgemeine Einführung (ISO 9241–1:1997) (enthält Änderung AMD 1:2001); Deutsche Fassung EN ISO 9241–1:1997 + A1:2001. Beuth Verlag, Berlin (2002)

    Google Scholar 

  29. Han, J., Haihong, E., Le, G., Du, J.: Survey on NoSQL database. In: 2011 6th International Conference on Pervasive Computing and Applications, pp. 363–366 (2011)

    Google Scholar 

  30. Katragadda, R., Tirumala, S.S., Nandigam, D.: ETL tools for data warehousing: an empirical study of open source talend studio versus microsoft ssis. In: Computing Conference Papers [147] (2015)

    Google Scholar 

  31. Kaur, K., Sachdeva, M.: Performance evaluation of NewSQL databases. In: 2017 International Conference on Inventive Systems and Control (ICISC), pp. 1–5. IEEE (2017)

    Google Scholar 

  32. Kherdekar, V.A., Metkewar, P.S.: A technical comprehensive survey of ETL tools. In: Advanced Engineering Research and Applications, p. 20 (2016)

    Google Scholar 

  33. Kumar, R., Gupta, N., Maharwal, H., Charu, S., Yadav, K.: Critical analysis of database management using NewSQL. Int. J. Comput. Sci. Mob. Comput. 3, 434–438 (2014)

    Google Scholar 

  34. Cockroach Labs: Cockroach labs, the company building cockroachdb (2020). https://cockroachlabs.com/

  35. Leavitt, N.: Will NoSQL databases live up to their promise? Computer 43(2), 12–14 (2010)

    Article  Google Scholar 

  36. Google LLC: about google scholar. https://scholar.google.com/intl/de/scholar/about.html

  37. Hitachi Vantara LLC: Pentaho enterprise edition — hitachi vantara (2020). https://www.hitachivantara.com/

  38. Mehra, K.K., Kumar, P., Choudhury, P., Lakkur, A.L., Samanta, S.: Extract, transform and load (ETL) system and method, 5 April 2017. US Patent 9,633,095

    Google Scholar 

  39. Mell, P., Grance, T., et al.: The NIST definition of cloud computing. NIST special publication 800–145 (2011)

    Google Scholar 

  40. Moniruzzaman, A.B.M.: NewSQL: towards next-generation scalable RDBMS for online transaction processing (OLTP) for big data management. Int. J. Database Theory Appl. 7 (2014)

    Google Scholar 

  41. NuoDB: Nuodb home — nuodb (2020). https://nuodb.com/

  42. OutSystems: the state of application development: Is it ready for disruption? Technical report, Department of Computer Science, Michigan State University, OutSystems: Boston, MA, USA, September 2019

    Google Scholar 

  43. Richardson, C., Rymer, J.R.: New Development Platforms Emerge for Customer-Facing Applications. Forrester, Cambridge (2014)

    Google Scholar 

  44. Scowen, G., Regenbrecht, H.: Increased popularity through compliance with usability guidelines in e-learning web sites. Int. J. Inf. Technol. Web Eng. (IJITWE) 4(3), 38–57 (2009)

    Article  Google Scholar 

  45. SingleStore, I.: Singlestore is the database of nowâ„¢ powering modern applications and analytical systems (2020). https://www.singlestore.com/

  46. Song, X., Yan, X., Yang, L.: Design ETL metamodel based on UML profile. In: 2009 Second International Symposium on Knowledge Acquisition and Modeling, vol. 3, pp. 69–72. IEEE (2009)

    Google Scholar 

  47. Talend: Talend - a cloud data integration leader (modern etl) (2020). https://www.talend.com/

  48. Theodorou, V., Abelló, A., Lehner, W.: Quality measures for ETL processes. In: International Conference on Data Warehousing and Knowledge Discovery, pp. 9–22. Springer (2014)

    Google Scholar 

  49. VoltDB I.: Home - voltdb (2020). https://www.voltdb.com/

  50. Zaidi, E., Thoo, E., Heudecker, N., Menon, S., Thanaraj, R.: Gartner magic quadrant for data integration tools. Gartner Group (2020)

    Google Scholar 

  51. Zaidi, E., Thoo, E., Heudecker, N., Menon, S., Thanaraj, R.: Magic quadrant for data integration tools 2020 (2020)

    Google Scholar 

  52. Zamanian, K., Nesamoney, D.: Apparatus and method for performing data transformations in data warehousing, 15 January 2002. US Patent 6,339,775

    Google Scholar 

  53. Zhang, Q., Cheng, L., Boutaba, R.: Cloud computing: state-of-the-art and research challenges. J. Internet Serv. Appl. 1(1), 7–18 (2010)

    Article  Google Scholar 

Download references

Acknowledgments

This research was made possible by funding from the ICT-AGRI-FOOD 2020 Joint Call. This work was supported by a grant of the Romanian National Authority for Scientific Research and Innovation, CCCDI - UEFISCDI, project number COFUND-ICT-AGRI-FOOD-GOHYDRO 200/2020, within PNCDI III.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sarah Myriam Lydia Hahn .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hahn, S.M.L., Chereja, I., Matei, O. (2021). Analysis of Transformation Tools Applicable on NewSQL Databases. In: Silhavy, R. (eds) Software Engineering and Algorithms. CSOC 2021. Lecture Notes in Networks and Systems, vol 230. Springer, Cham. https://doi.org/10.1007/978-3-030-77442-4_16

Download citation

Publish with us

Policies and ethics