Named Entities Recognition in Kazakh Text by SpaCy NER Models
This paper presents a study of named entity recognition (NER) in the Kazakh language using the transformer model of the spaCy library. There are a few works have been done on the NER in the Kazakh language and there is only one open data set. This indicates that the Kazakh language is a low-resource language and the relevance of the study. The article considered all scientific papers written so far on the NER in the Kazakh language and defined the main problems of subject area based on analyzing of recently published research. It provides a formal description of the transformer model from spaCy for NER. To identify the named entities from Kazakh-language texts, a data set was prepared from scientific works, and the recognition of named entities were carried out in a complete pipeline sequence. The main focus was on preparing annotated data for implementing NER from Kazakh texts and on the pipeline NER component.
Authors
- Aigerim Yerimbetova (ORCID: https://orcid.org/0000-0002-2013-1513)
- Нуржан Мукажанов (ORCID: https://orcid.org/0000-0003-4835-5751)
- Mussa Turdalyuly (ORCID: https://orcid.org/0000-0002-1470-3706)
- Bakzhan Sakenov (ORCID: https://orcid.org/0000-0002-9849-6176)
Institutions
- Institute of Information and Computational Technologies (KZ)
- Ministry of Science and Higher Education of the Republic of Kazakhstan (KZ)
Publication Details
- Published
- 2024-10-26
- DOI
- https://doi.org/10.1109/ubmk63289.2024.10773475
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Ministry of Education and Science of the Republic of Kazakhstan