Abstract

SVOBODA, Lukáš  and  BRYCHCIN, Tomáš. Enriching Word Embeddings with Global Information and Testing on Highly Inflected Language. Comp. y Sist. [online]. 2019, vol.23, n.3, pp.773-783.  Epub Aug 09, 2021. ISSN 2007-9737.  https://doi.org/10.13053/cys-23-3-3268.

In this paper we evaluate our new approach based on the Continuous Bag-of-Words and Skip-gram models enriched with global context information on highly inflected Czech language and compare it with English results. As a source of information we use Wikipedia, where articles are organized in a hierarchy of categories. These categories provide useful topical information about each article. Both models are evaluated on standard word similarity and word analogy datasets. Proposed models outperform other word representation methods when similar size of training data is used. Model provide similar performance especially with methods trained on much larger datasets.

Keywords : Highly inflected language; word embeddings.

        · text in English     · English ( pdf )