An Algorithm for Genre Imbalance Correction in the Russian Subcorpus of the Google Books Ngram Corpus
Recently, the latest version of the Google Books Ngram was shown to be imbalanced.This corpus being an important and widely used database, the imbalance can affect the results of research in different areas.In the paper, we present an algorithm for correcting the dynamics of word frequency in the Google Books Ngram corpus.The algorithm takes into account the discovered imbalance of the main literary styles-fiction, publicistics, and nonfiction.The rationale of the algorithm is given, as well as examples of correction.
Authors
- Anna Ivleva (ORCID: https://orcid.org/0000-0002-2670-6795)
- Valery Solovyev (ORCID: https://orcid.org/0000-0002-7780-9823)
Institutions
- Kazan Federal University (RU)
Publication Details
- Journal
- Computational Linguistics and Intellectual Technologies
- Published
- 2025-01-01
- DOI
- https://doi.org/10.28995/2075-7182-2025-23-137-146
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Russian Science Foundation