Skip to main content
SpringerLink
Log in

ProMoTe: A Data Product Model Template for Data Meshes

  • Conference paper
  • First Online:
Conceptual Modeling (ER 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14320))

Included in the following conference series:

Abstract

As the shortcomings of monolithic data platforms such as data lakes are quickly becoming more grave and evident, many organisations are struggling to transition to data meshes, making data available for consumption in a decentralised manner. However, the emerging data mesh paradigm fails to provide sufficient (modelling) support to effectively create, manage, and describe data products, the architectural quanta of a data mesh. In this work, we introduce the data Product Model Template (ProMoTe): a formal meta-model of data products that is fully aligned with a data mesh. ProMoTe was devised, explored and partially validated based on industry requirements in tandem with academic literature and is currently being used by a major Dutch Telecom company to enable their data mesh transition.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Although they can be extended to external data markets or data spaces [12].

  2. 2.

    https://www.w3.org/TR/vocab-dcat-2/.

  3. 3.

    https://www.kpn.com/.

  4. 4.

    https://datahubproject.io/.

  5. 5.

    and consequently, for describing such data products.

  6. 6.

    https://www.w3.org/TR/vocab-dcat-2/.

  7. 7.

    https://www.dublincore.org/specifications/dublin-core/dcmi-terms/.

  8. 8.

    https://www.w3.org/TR/skos-reference/.

  9. 9.

    https://cloud.google.com/architecture/describe-organize-data-products-resources-data-mesh#the_data_product_template.

  10. 10.

    https://docs.aws.amazon.com/marketplace/latest/userguide/data-products.html.

  11. 11.

    https://learn.microsoft.com/en-us/azure/cloud-adoption-framework/scenarios/cloud-scale-analytics/architectures/what-is-data-product.

  12. 12.

    https://github.com/agile-lab-dev/Data-Product-Specification.

  13. 13.

    https://dpds.opendatamesh.org/resources/specifications/1.0.0-DRAFT/.

  14. 14.

    https://github.com/Stefan-Driessen/ProMoTe.

References

  1. Beck, K., Beedle, M., Bennekum, A.V., Cockburn, A.: The agile manifesto (2001). https://www.agilealliance.org/wp-content/uploads/2019/09/agile-manifesto-download-2019.pdf

  2. Dehghani, Z.: Data Mesh: Delivering Data-Driven Value at Scale, 1st edn. O’Reilly (2022)

    Google Scholar 

  3. Driessen, S., Monsieur, G., van den Heuvel, W.J.: Data product metadata management: an industrial perspective (2022)

    Google Scholar 

  4. Driessen, S., Monsieur, G., Heuvel, W.V.D.: Data market design: a systematic literature review. IEEE Access 10, 1 (2022). https://doi.org/10.1109/access.2022.3161478

    Article  Google Scholar 

  5. Eichler, R., Gröger, C., Hoos, E., Schwarz, H., Mitschang, B.: From data asset to data product - the role of the data provider in the enterprise data marketplace. In: Barzen, J., Leymann, F., Dustdar, S. (eds.) Service-Oriented Computing, SummerSOC 2022. Communications in Computer and Information Science, vol. 1603, pp. 119–138. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-18304-1_7

    Chapter  Google Scholar 

  6. Goedegebuure, A., et al.: Data mesh: a systematic gray literature review (2023)

    Google Scholar 

  7. Hooshmand, Y., Resch, J., Wischnewski, P., Patil, P.: From a monolithic PLM landscape to a federated domain and data mesh, pp. 713–722 (2022)

    Google Scholar 

  8. Kennedy, J., Subramaniam, P., Galhotra, S., Fernandez, R.C.: Revisiting online data markets in 2022. ACM SIGMOD Rec. 51, 30–37 (2022). https://doi.org/10.1145/3572751.3572757

    Article  Google Scholar 

  9. Loukiala, A., Joutsenlahti, J.-P., Raatikainen, M., Mikkonen, T., Lehtonen, T.: Migrating from a centralized data warehouse to a decentralized data platform architecture. In: Ardito, L., Jedlitschka, A., Morisio, M., Torchiano, M. (eds.) PROFES 2021. LNCS, vol. 13126, pp. 36–48. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-91452-3_3

    Chapter  Google Scholar 

  10. Machado, I.A., Costa, C., Santos, M.Y.: Data mesh: concepts and principles of a paradigm shift in data architectures, vol. 196, pp. 263–271. Elsevier B.V. (2021). https://doi.org/10.1016/j.procs.2021.12.013

  11. Olson, J.A.: Data as a service: are we in the clouds? J. Map Geography Libr. 6, 76–78 (2009). https://doi.org/10.1080/15420350903432739

    Article  Google Scholar 

  12. Otto, B., Steinbuß, S., Teuscher, A., Lohmann, S.: IDSA reference architecture model. International Data Spaces Association (2019). https://internationaldataspaces.org/download/16630/

  13. Ozyilmaz, K.R., Dogan, M., Yurdakul, A.: IDMoB: IoT data marketplace on blockchain. In: Proceedings - 2018 Crypto Valley Conference on Blockchain Technology, CVCBT 2018, pp. 11–19 (2018). https://doi.org/10.1109/CVCBT.2018.00007

  14. Pillmann, J., Sliwa, B., Schmutzler, J., Ide, C., Wietfeld, C.: Car-to-cloud communication traffic analysis based on the common vehicle information model, pp. 1–5 (2018)

    Google Scholar 

  15. Sakr, M.: A data model and algorithms for a spatial data marketplace. Int. J. Geograph. Inf. Sci. 32, 2140–2168 (2018). https://doi.org/10.1080/13658816.2018.1484124

    Article  Google Scholar 

  16. Shakeri, S., et al.: Modeling and matching digital data marketplace policies. In: Proceedings - IEEE 15th International Conference on eScience, eScience 2019, pp. 570–577 (2019). https://doi.org/10.1109/eScience.2019.00078

  17. Spiekermann, M., Tebernum, D., Wenzel, S., Otto, B.: A metadata model for data goods. In: MKWI 2018 - Multikonferenz Wirtschaftsinformatik 2018-March, pp. 326–337 (2018)

    Google Scholar 

  18. Sánchez, L., et al.: Federation of internet of things testbeds for the realization of a semantically-enabled multi-domain data marketplace. Sensors (Switzerland) 18, 3375 (2018). https://doi.org/10.3390/s18103375, https://www.mdpi.com/1424-8220/18/10/3375

  19. (Thoughtworks), Z.D.: How to move beyond a monothilitic data lake to a distributed data mesh (2019). https://martinfowler.com/articles/data-monolith-to-mesh.html

  20. Vu, Q.H., Pham, T.V., Truong, H.L., Dustdar, S., Asal, R.: DEMODS: a description model for data-as-a-service. In: Proceedings - International Conference on Advanced Information Networking and Applications, AINA, pp. 605–612 (2012). https://doi.org/10.1109/AINA.2012.91

  21. Yuan, J., Li, H.: Research on the standardization model of data semantics in the knowledge graph construction of oil & gas industry. Comput. Stand. Interfaces 84, 103705 (2023). https://doi.org/10.1016/J.CSI.2022.103705

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Tilburg University, Sint-Janssingel 92, ’s-Hertogenbosch, The Netherlands

    Stefan Driessen & Willem-Jan van den Heuvel

  2. Eindhoven Unversity of Technology, Sint-Janssingel 92, ’s-Hertogenbosch, The Netherlands

    Geert Monsieur

Authors
  1. Stefan Driessen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Willem-Jan van den Heuvel
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Geert Monsieur
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stefan Driessen .

Editor information

Editors and Affiliations

  1. Federal University of Espírito Santo, Vitória, Brazil

    João Paulo A. Almeida

  2. Universidade de Lisboa, Lisbon, Portugal

    José Borbinha

  3. University of Twente, Enschede, The Netherlands

    Giancarlo Guizzardi

  4. University of Auckland, Auckland, New Zealand

    Sebastian Link

  5. Stockholm University, Kista, Sweden

    Jelena Zdravkovic

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Driessen, S., den Heuvel, WJ.v., Monsieur, G. (2023). ProMoTe: A Data Product Model Template for Data Meshes. In: Almeida, J.P.A., Borbinha, J., Guizzardi, G., Link, S., Zdravkovic, J. (eds) Conceptual Modeling. ER 2023. Lecture Notes in Computer Science, vol 14320. Springer, Cham. https://doi.org/10.1007/978-3-031-47262-6_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-47262-6_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-47261-9

  • Online ISBN: 978-3-031-47262-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation