Abstract
Nowadays, open data has become a prominent information source for creating value-added product and services. Actually, open data portal initiatives are adopted by most of the governments to supply their public sector information, usually in the form of tabular data such as spreadsheets or CSV files. Most open data portals allow reusers to retrieve tabular open data by means of a keyword-based search engine over metadata. However, these search engines rely on the (not so often good enough) metadata quality, which must be complete, descriptive, and representative of the tabular open data content. Moreover, keyword-based search is not always an adequate solution for retrieving open data, since it does not consider the tabular nature of (most) open data and search results can be useless for reusers (e.g., when they attempt to find open data to be integrated with a given tabular dataset). To overcome these problems, this paper presents Search!, a search engine that enables users to pose an input query table to retrieve adequate tabular open data to be integrated with. To do so, semantic searches are performed by leveraging word embeddings to compute the similarity between column names and cell contents of tabular data. The relevance criteria established in the search engine aims to retrieve a ranking of tabular open datasets suitable for completion and augmentation, and thus, enabling integration with the input query table.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
- 3.
- 4.
- 5.
- 6.
- 7.
- 8.
- 9.
- 10.
- 11.
- 12.
- 13.
- 14.
References
Altayar, M.S.: Motivations for open data adoption: an institutional theory perspective. Government Inf. Q. 35(4), 633–643 (2018)
Bizer, C., Heath, T., Berners-Lee, T.: Linked data: The story so far. In: Semantic Services, Interoperability and Web Applications: Emerging Concepts, pp. 205–227. IGI global (2011)
Chapman, A., Missier, P., Simonelli, G., Torlone, R.: Capturing and querying fine-grained provenance of preprocessing pipelines in data science. Proc. VLDB Endow. 14(4), 507–520 (2020)
Chen, Z., Trabelsi, M., Heflin, J., Xu, Y., Davison, B.D.: Table search using a deep contextualized language model. In: Proceedings of 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 589–598. Association for Computing Machinery (2020)
Devlin, J., Chang, M., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of Conference of the North American Chapter of the ACL: Human Language Technologies, NAACL-HLT 2019, Minneapolis, USA, 2–7 June 2019, pp. 4171–4186. Association for Computational Linguistics (2019)
González-Mora, C., Tomás, D., Garrigós, I., Zubcoff, J.J., Mazón, J.N.: Model-driven development of web apis to access integrated tabular open data. IEEE Access 8, 202669–202686 (2020)
Grave, E., Bojanowski, P., Gupta, P., Joulin, A., Mikolov, T.: Learning word vectors for 157 languages. In: Proceedings of the International Conference on Language Resources and Evaluation (LREC 2018) (2018)
Gupta, S., Kanchinadam, T., Conathan, D., Fung, G.: Task-optimized word embeddings for text classification representations. Front. Appli. Math. Stat. 5, 1–67 (2020)
Gysel, C., Rijke, M., Kanoulas, E.: Neural vector spaces for unsupervised information retrieval. ACM Trans. Inf. Syst. 36 (2017)
Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. In: 1st International Conference on Learning Representations, ICLR 2013 pp. 1–12 (2013)
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Proceedings of 26th International Conference on Neural Information Processing Systems, NIPS 2013, Red Hook, NY, USA, vol. 2, pp. 3111–3119 (2013)
Neumaier, S., Umbrich, J., Polleres, A.: Automated quality assessment of metadata across open data portals. J. Data Inf. Qual. (JDIQ) 8(1), 1–29 (2016)
Zhang, S., Balog, K.: Ad hoc table retrieval using semantic similarity. In: Proceedings of the 2018 World Wide Web Conference, WWW 2018, International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, pp. 1553–1562 (2018)
Acknowledgements
This research has been funded by project “Desarrollo de un ecosistema de datos abiertos para transformar el sector turístico” (GVA-COVID19/2021/103) funded by ”Conselleria de Innovación, Universidades, Ciencia y Sociedad Digital de la Generalitat Valenciana”.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Berenguer, A., Mazón, JN., Tomás, D. (2022). A Tabular Open Data Search Engine Based on Word Embeddings for Data Integration. In: Chiusano, S., et al. New Trends in Database and Information Systems. ADBIS 2022. Communications in Computer and Information Science, vol 1652. Springer, Cham. https://doi.org/10.1007/978-3-031-15743-1_10
Download citation
DOI: https://doi.org/10.1007/978-3-031-15743-1_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-15742-4
Online ISBN: 978-3-031-15743-1
eBook Packages: Computer ScienceComputer Science (R0)