Abstract
Word embeddings have been widely used in Natural Language Processing as the input to neural networks. Such word embeddings can help in the understanding of the final objective and the keywords in a sentence. As such, in this work, we study the impact of different word embeddings trained with general and specific corpora using Joint Natural Language Understanding in a Spanish medication domain. We generate data using templates for training the model. The model is used for intent detection and slot-filling. We compare word2vec and fastText as word embeddings and ELMo and BERT as language models. We use three different corpora to train the embeddings: the training data generated for this scenario, the Spanish Wikipedia as general domain and the Spanish drug database as specialized data. The best result was obtained with word2vec continuous bag of words model learned with Spanish Wikipedia, obtaining a 71.77% F1-score for intent detection, an intent accuracy of 69.37% and a 74.36% F1-score for slot-filling.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Alesanco, Á., Sancho, J., Gilaberte, Y., Abarca, E., García, J.: Bots in messaging platforms, a new paradigm in healthcare delivery: application to custom prescription in dermatology. In: EMBEC & NBC 2017, pp. 185–188. Springer (2017)
Stoica, A., Kadar, T., Lemnaru, C., Potolea, R., Dînşoreanu, M.: The impact of data challenges on intent detection and slot filling for the home assistant scenario. In: 2019 IEEE 15th International Conference on Intelligent Computer Communication and Processing (ICCP), pp. 41–47. IEEE (2019)
Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013)
Bojanowski, P., Grave, E., Joulin, A., Mikolov, T.: Enriching word vectors with subword information. Trans. Ass. Comput. Linguist. 5, 135–146 (2017)
Peters, M.E., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., Zettlemoyer, L.: Deep contextualized word representations. arXiv preprint arXiv:1802.05365 (2018)
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)
Wang, Y., Liu, S., Afzal, N., Rastegar-Mojarad, M., Wang, L., Shen, F., Kingsbury, P., Liu, H.: A comparison of word embeddings for the biomedical natural language processing. J. Biomed. Inform. 87, 12–20 (2018)
Neuraz, A., Looten, V., Rance, B., Daniel, N., Garcelon, N., Llanos, L.C., Burgun, A., Rosset, S.: Do you need embeddings trained on a massive specialized corpus for your clinical natural language processing task? Stud. Health Technol. Inform. 264, 1558–1559 (2019)
Ghannay, S., Neuraz, A., Rosset, S.: What is best for spoken language understanding: small but task-dependant embeddings or huge but out-of-domain embeddings? In: ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 8114–8118. IEEE (2020)
Segura-Bedmar, I., Martínez, P.: Simplifying drug package leaflets written in Spanish by using word embedding. J. Biomed. Semant. 8(1), 45 (2017)
Soares, F., Villegas, M., Gonzalez-Agirre, A., Krallinger, M., Armengol-Estapé, J.: Medical word embeddings for Spanish: development and evaluation. In: Proceedings of the 2nd Clinical Natural Language Processing Workshop, pp. 124–133 (2019)
Roca, S., Hernández, M., Sancho, J., García, J., Alesanco, Á.: Virtual assistant prototype for managing medication using messaging platforms. In: Mediterranean Conference on Medical and Biological Engineering and Computing, pp. 954–961. Springer, Heidelberg (2019)
multilstm. https://github.com/SNUDerek/multiLSTM. Accessed 27 Jan 2020
Boulanger, H.: Evaluation systématique d’une méthode commune de génération. In: Actes de la Conférence sur le Traitement Automatique des Langues Naturelles. Volume 3: Rencontre des Étudiants Chercheurs en Informatique pour le Traitement Automatique des Langues, pp. 43–56. Association pour le Traitement Automatique des Langues, Nancy, France (2020). http://talnarchives.atala.org/RECITAL/RECITAL-2020/180.pdf, systematic evaluation of a common generation method
Cima - centro de inforamción de medicamentos. https://cima.aemps.es/cima/publico/home.html. Accessed 24 Jan 2020
Acknowledgements
Research funded by Ministerio de Economía, Industria y Competitividad from Gobierno de España and European Regional Development Fund (TIN2016-76770-R and BES-2017-082017) and Gobierno de Aragón and FEDER “Construyendo Europa desde Aragón” (T31_20R).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
The authors declare that they have no conflict of interest.
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Roca, S., Rosset, S., García, J., Alesanco, Á. (2021). Evaluation of Embeddings in Medication Domain for Spanish Language Using Joint Natural Language Understanding. In: Jarm, T., Cvetkoska, A., Mahnič-Kalamiza, S., Miklavcic, D. (eds) 8th European Medical and Biological Engineering Conference. EMBEC 2020. IFMBE Proceedings, vol 80. Springer, Cham. https://doi.org/10.1007/978-3-030-64610-3_58
Download citation
DOI: https://doi.org/10.1007/978-3-030-64610-3_58
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-64609-7
Online ISBN: 978-3-030-64610-3
eBook Packages: EngineeringEngineering (R0)