The Process of Lemmatization and Stemming in the Automatic Morphological Analysis of Uzbek Texts

The Uzbek language belongs to the Turkic language family and is one of the most popular languages. Currently, the number of people who speak Uzbek as their mother tongue exceeds 33 million worldwide, the number of Uzbek speakers on earth has exceeded 60 million, and Uzbek is taught in more than 50 higher educational institutions in foreign countries. The use of the Uzbek language is expanding in the world. Uzbek-language content has also increased on the global Internet. This, in turn, requires the improvement of the Uzbek Information Retrieval technique, for this, the need to improve the processes of lemmatization and stemming in the Uzbek language. Lemmatization and stemming are the most important technologies in information retrieval, translation programs, and language corpora. Lemmatization is mainly necessary for inflected languages. The Uzbek language is considered an agglutinative language. Therefore, in the Uzbek language, there are no cases of inflection, that is, the border of the affix with the root disappears. But there are sound changes (“letter changes” in the article). The main morphological features of the Uzbek language, the linguistic rules included in the “Rule block” of the Uztextanalysis analysis program are given in the article: including the algorithms of letter reduction, letter addition and letter change events, Algorithms of stemming and lemmatization in the Uzbek language, applications and functions of both technologies for the Uzbek language, advantages and disadvantages of lemmatization and stemming for the Uzbek language, the difference between the term “morphological analysis” in NLP and Uzbek linguistics are covered.