Araneum Uzbecicum: A Gigaword Web-Crawled Uzbek Corpus
We want to introduce a Project of creation of a web-crawled Uzbek corpus. The main steps related to data capture, pre-processing, tokenization, deduplication, PoS tagging and lemmatization are discussed, and some query examples are shown. This article analyzes the problems in the process of creating and lemmatization the corpus of Araneum Uzbecicum. We also show word embeddings created from the Uzbek data. The Word embeddings function serves as a useful tool for researching the semantic relations in the Uzbek language, word context and valence. Also, the paradigm created by the Word embeddings function helps to perfect dictionaries.
Authors
- Khamroeva Shahlo Mirdjonovna (ORCID: https://orcid.org/0000-0002-5429-4708)
- Владимир Бенко (ORCID: https://orcid.org/0000-0002-4600-5515)
- Radovan Garabík (ORCID: https://orcid.org/0000-0003-1691-3157)
Institutions
- Slovak Academy of Sciences (SK)
Publication Details
- Published
- 2024-10-26
- DOI
- https://doi.org/10.1109/ubmk63289.2024.10773454
- Citations
- 1
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.35
Funders
- Vedecká Grantová Agentúra MŠVVaŠ SR a SAV