Skip to main content
Log in

CDPort: A Portability Framework for NoSQL Datastores

  • Research Article - Computer Engineering and Computer Science
  • Published:
Arabian Journal for Science and Engineering Aims and scope Submit manuscript

Abstract

Cloud computing technology has been growing over the past few years. Currently, cloud providers provide their consumers with several cloud services. However, developers face many difficulties when they have to move their data or software from one cloud platform to another due to the lack of standards. This challenge is considered as one of the key obstacles that prevent many applications from moving to the cloud environment. In this paper, we focus on the challenge of data portability. We propose a common data model and a standardized API for SQL and NoSQL cloud databases. In particular, our approach hides the possible variations of the backend data storage models from the application layer. In addition, our framework is equipped with tools that support the conversion, transformation and data exchange between the different data storage models. The current implementation of our framework supports four different data storage systems: Amazon RDS, Google Datastore, Amazon SimpleDB and MongoDB. However, our framework is designed in a flexible way such that it can be easily extended to support other data storage systems. Moreover, we offer a standard query abstraction to enable automatic translation between NoSQL query patterns and their associated SQL queries (in both directions). The experimental evaluation of our framework shows that using our framework eliminates or minimizes the effort of rewriting the application code when the backend data storage system is changed. Further, the proposed transformation tool reduces the effort of maintaining data portability between the different data models that we have considered.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Marston S., Li Z., Bandyopadhyay S., Zhang J., Ghalsasi A.: Cloud computing the business perspective. Decis. Support Syst. 51(1), 176–189 (2011)

    Article  Google Scholar 

  2. Loutas, N.; Kamateri, E.; Tarabanis, K.: A semantic interoperability framework for cloud platform as a service. In: 2011 IEEE Third International Conference on Cloud Computing Technology and Science (CloudCom), pp. 280–287 (2011)

  3. Kostoska, M.; Gusev, M.; Ristov, S.; Kiroski, K.: Cloud computing interoperability approaches-possibilities and challenges. In: BCI (Local), pp. 30–34 (2012)

  4. Harsh, P.; Dudouet, F.; Cascella, R.G.; Jégou, Y.; Morin, C.: Using open standards for interoperability issues, solutions, and challenges facing cloud computing. In: 8th International Conference on Network and Service Management, CNSM 2012, Las Vegas, NV, USA, October 22–26, 2012, pp. 435–440 (2012)

  5. Zhang Z., Wu C., Cheung D.W.L.: A survey on cloud interoperability: taxonomies, standards, and practice. SIGMETRICS Perform. Eval. Rev. 40(4), 13–22 (2013)

    Article  Google Scholar 

  6. Loutas, N.; Kamateri, E.; Bosi, F.; Tarabanis, K.A.: Cloud computing interoperability: the state of play. In: IEEE 3rd International Conference on Cloud Computing Technology and Science, CloudCom 2011, Athens, Greece, November 29–December 1, 2011, pp. 752–757 (2011)

  7. Stravoskoufos, K.; Preventis, A.; Sotiriadis, S.; Petrakis, E.G.M.: A survey on approaches for interoperability and portability of cloud computing services (2014)

  8. Shirazi, M.N.; Ho, Chin, K.; Dolatabadi, H.: Design patterns to enable data portability between clouds’ databases. In: 12th International Conference on Computational Science and its Applications, ICCSA 2012, Salvador, Bahia, Brazil, June 18–21, 2012, pp. 117–120 (2012)

  9. Petcu D., Macariu G., Panica S., Crăciun C.: Portable cloud applications from theory to practice. Future Gener. Comput. Syst. 29(6), 1417–1430 (2013)

    Article  Google Scholar 

  10. Escalera, M.F.P.; Chavez, M.A.L.: UML model of a standard API for cloud computing application development. In: 2012 9th International Conference on Electrical Engineering, Computing Science and Automatic Control (CCE), September, pp. 1–8 (2012)

  11. Sakr S., Liu A., Batista D.M., Alomari M.: A survey of large scale data management approaches in cloud environments. IEEE Commun. Surv. Tutor. 13(3), 311–336 (2011)

    Article  Google Scholar 

  12. Hecht, R.; Jablonski, S.: Nosql evaluation: a use case oriented survey. In: 2011 International Conference on Cloud and Service Computing (CSC), pp. 336–341 (2011)

  13. Sakr S.: Cloud-hosted databases: technologies, challenges and opportunities. Cluster Comput. 17(2), 487–502 (2014)

    Article  Google Scholar 

  14. Alomari, E.; Barnawi, A.; Sakr, S.: CDPort: a framework of data portability in cloud platforms. In: The 16th International Conference on Information Integration and Web-Based Applications & Services (iiWAS2014), Hanoi, Vietnam, December 2014. ACM International Conference

  15. Lewis, G.A.: Role of standards in cloud-computing interoperability. In: 46th Hawaii International Conference on System Sciences, HICSS 2013, Wailea, HI, January 7–10, 2013, pp. 1652–1661 (2013)

  16. Petcu D., Martino B.D., Venticinque S., Rak M., Máhr T., Lopez G.E., Brito F., Cossu R., Stopar M., Perka S., Stankovski V.: Experiences in building a mOSAIC of clouds. J. Cloud Comput. Adv. Syst. Appl. 2(1), 1–22 (2013)

    Article  MATH  Google Scholar 

  17. Di Nitto, E.; da Silva, M.A.A.; Ardagna, D.; Casale, G.; Craciun, C.D.; Ferry, N.; Muntes, V.; Solberg, A.: Supporting the development and operation of multi-cloud applications: The modaclouds approach. In: 15th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing, SYNASC 2013, Timisoara, Romania, September 23–26, 2013, pp. 417–423 (2013)

  18. Petcu, D.: Portability and interoperability between clouds: Challenges and case study. In: Abramowicz, W., Llorente, I.M., Surridge, M., Zisman, A.,Vayssire, J. (eds.) Towards a Service-Based Internet, number 6994 in Lecture Notes in Computer Science, pp. 62–74. Springer, Berlin (2011)

  19. Liao C.-S., Shih J.-M., Chang R.-S.: Simplifying mapreduce data processing. IJCSE 8(3), 219–226 (2013)

    Article  Google Scholar 

  20. Silva L.A.B., Costa C., Oliveira J.L.: A common API for delivering services over multi-vendor cloud resources. J. Syst. Softw. 86(9), 2309–2317 (2013)

    Article  Google Scholar 

  21. Hill, Z.; Humphrey, M.: CSAL: a cloud storage abstraction layer to enable portable cloud applications. In: Proceedings on Cloud Computing, Second International Conference, CloudCom 2010, November 30–December 3, 2010, Indianapolis, IN, pp. 504–511 (2010)

  22. Lawrence, R.: Integration and virtualization of relational SQL and NoSQL systems including MySQL and MongoDB. In: 2014 International Conference on Computational Science and Computational Intelligence (CSCI), vol. 1, March, pp. 285–290 (2014)

  23. Sellami, R.; Bhiri, S.; Defude, B.: ODBAPI: a unified REST API for relational and NoSQL data stores. In: 2014 IEEE International Congress on Big Data (BigData Congress), June, pp. 653–660 (2014)

  24. Cur, O.; Hecht, R.; Duc, C.L.; Lamolle, M.: Data integration over NoSQL stores using access path based mappings. In: Hameurlain, A., Liddle, S.W., Schewe, K.-D., Zhou, X. (eds.) Database and Expert Systems Applications, number 6860 in Lecture Notes in Computer Science, pp. 481–495. Springer, Berlin (2011)

  25. Polese, G.; Vacca, M.: A dialogue-based model for the query synchronization problem. In: IEEE 5th International Conference on Intelligent Computer Communication and Processing, 2009. ICCP 2009, August, pp. 67–70 (2009)

  26. Tahara, D.; Diamond, T.; Abadi, D.J.: Sinew: a SQL system for multi-structured data. In: Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data, SIGMOD ’14, pp. 815–826, ACM, New York, NY (2014)

  27. Roijackers, J.; Fletcher, G.H.L.: On bridging relational and document-centric data stores. In: Gottlob, G., Grasso, G., Olteanu, D., Schallhart, C. (eds.) Big Data, Number 7968 in Lecture Notes in Computer Science, pp. 135–148. Springer, Berlin (2013)

  28. Curino, C.; Jones, E.P.C.; Popa, R.A.; Malviya,N.; Wu, E.; Madden, S.; Balakrishnan, H.; Zeldovich, N.: Relational cloud: a database service for the cloud. In: Proceedings on CIDR 2011, Fifth Biennial Conference on Innovative Data Systems Research, Asilomar, CA, January 9–12, 2011, Online, pp. 235–240 (2011)

  29. Han, J.; Haihong, E.; Le, G.; Du, J.: Survey on NoSQL database. In: 2011 6th International Conference on Pervasive Computing and Applications (ICPCA), October, pp. 363–366 (2011)

  30. Gonidis, F.; Simons, A.J.H.; Paraskakis, I.; Kourtesis, D.: Cloud application portability: an initial view. In: Proceedings of the 6th Balkan Conference in Informatics, BCI ’13, pp. 275–282, ACM, New York, NY (2013)

  31. Sadalage P.J.; Fowler M.: NoSQL Distilled: A Brief Guide to the Emerging World of Polyglot Persistence. Pearson Education, India (2012)

  32. Livenson, I.; Laure, E.: Towards transparent integration of heterogeneous cloud storage platforms. In: Proceedings of the Fourth International Workshop on Data-intensive Distributed Computing, DIDC ’11, pp. 27–34, ACM, New York, NY (2011)

  33. Sakr S., Al-Naymat G.: Graph indexing and querying: a review. IJWIS 6(2), 101–120 (2010)

    Google Scholar 

  34. Sakr, S.; Pardede, E. (eds.) Graph Data Management: Techniques and Applications. IGI Global, Hershey, PA (2011)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sherif Sakr.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Alomari, E., Barnawi, A. & Sakr, S. CDPort: A Portability Framework for NoSQL Datastores. Arab J Sci Eng 40, 2531–2553 (2015). https://doi.org/10.1007/s13369-015-1703-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13369-015-1703-0

Keywords

Navigation