Abstract
In the paper vector-space semantic models based on Word2Vec word embeddings algorithm and a count-based association-oriented algorithm are evaluated and compared by measuring association strength between Russian nouns and adjectives. A dataset of nouns and associated adjectives is used as the test set for pseudodisambiguation task. Models are trained with corpora of Russian fiction. A measure of lexical association anomaly is applied evaluating similarity between the initial noun and the resulting attributive phrase. Results of association strength are reported for models characterized by different parameter values; the best parameter value combinations are proposed. The test exemplars producing the error rate are manually annotated, and the model errors are categorized in terms of their linguistic nature and compositionality features.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
- 2.
- 3.
- 4.
- 5.
- 6.
- 7.
- 8.
References
Baroni, M., Bernardi, R., Zamparelli, R.: Frege in space: a program of compositional distributional semantics. Linguist. Issues Lang. Technol. 9 (2014)
Biemann, C.: Unsupervised and knowledge-free natural language processing in the structure discovery paradigm. Ph.D. thesis, Universität Leipzig (2007)
Bukia, G., Protopopova, E., Mitrofanova, O.: A corpus-driven estimation of association strength in lexical constructions. In: Sergey Balandin, T.T., Trifonova, U. (eds.) Proceedings of the AINL-ISMW FRUCT, pp. 147–152. FRUCT Oy, Finland (2015). http://fruct.org/publications/ainl-abstract/files/Buk.pdf
Goldberg, A.: Constructions: a construction grammar approach to argument structure (1994)
Kartsaklis, D., Sadrzadeh, M., et al.: Prior disambiguation of word tensors for constructing sentence vectors. In: Proceedings of EMNLP, pp. 1590–1601 (2013)
Kochmar, E., Briscoe, T.: Capturing anomalies in the choice of content words in compositional distributional semantic space. In: Proceedings of RANLP, pp. 365–372 (2013)
Kolb, P.: Disco: a multilingual database of distributionally similar words. In: Proceedings of KONVENS-2008, Berlin (2008)
Kutuzov, A., Andreev, I.: Texts in, meaning out: neural language models in semantic similarity task for russian. arXiv preprint arXiv:1504.08183 (2015)
Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, pp. 3111–3119 (2013)
Panchenko, A., Loukachevitch, N., Ustalov, D., Paperno, D., Meyer, C., Konstantinova, N.: Russe: the first workshop on Russian semantic similarity. In: Proceeding of the Dialogue 2015 Conference (2015)
Panchenko, A., Romanov, P., Morozova, O., Naets, H., Philippovich, A., Romanov, A., Fairon, C.: Serelex: search and visualization of semantically related words. In: Serdyukov, P., Braslavski, P., Kuznetsov, S.O., Kamps, J., Rüger, S., Agichtein, E., Segalovich, I., Yilmaz, E. (eds.) ECIR 2013. LNCS, vol. 7814, pp. 837–840. Springer, Heidelberg (2013). doi:10.1007/978-3-642-36973-5_97
Pekar, V., Staab, S.: Word classification based on combined measures of distributional and semantic similarity. In: Proceedings of the Tenth Conference on European Chapter of the Association for Computational Linguistics, vol. 2, pp. 147–150. Association for Computational Linguistics (2003)
Rehurek, R., Sojka, P.: Software framework for topic modelling with large corpora (2010)
Sahlgren, M.: The word-space model: using distributional analysis to represent syntagmatic and paradigmatic relations between words in high-dimensional vector spaces (2006)
Schütze, H.: Dimensions of meaning. In: Proceedings of Supercomputing 1992, pp. 787–796. IEEE (1992)
Vecchi, E.M., Baroni, M., Zamparelli, R.: (Linear) maps of the impossible: capturing semantic anomalies in distributional space. In: Proceedings of the Workshop on Distributional Semantics and Compositionality, pp. 1–9. Association for Computational Linguistics (2011)
Widdows, D., Cohen, T.: The semantic vectors package: new algorithms and public tools for distributional semantics. In: 2010 IEEE Fourth International Conference on Semantic Computing (ICSC), pp. 9–15. IEEE (2010)
Acknowledgments
The reported study is supported by RFBR grant № 16-06-00529 “Development of a linguistic toolkit for semantic analysis of Russian text corpora by statistical techniques”.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Panicheva, P., Protopopova, E., Bukia, G., Mitrofanova, O. (2017). Evaluating Distributional Semantic Models with Russian Noun-Adjective Compositions. In: Ignatov, D., et al. Analysis of Images, Social Networks and Texts. AIST 2016. Communications in Computer and Information Science, vol 661. Springer, Cham. https://doi.org/10.1007/978-3-319-52920-2_22
Download citation
DOI: https://doi.org/10.1007/978-3-319-52920-2_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-52919-6
Online ISBN: 978-3-319-52920-2
eBook Packages: Computer ScienceComputer Science (R0)