An Algorithm for Genre Imbalance Correction in the Russian Subcorpus of the Google Books Ngram Corpus

Recently, the latest version of the Google Books Ngram was shown to be imbalanced.This corpus being an important and widely used database, the imbalance can affect the results of research in different areas.In the paper, we present an algorithm for correcting the dynamics of word frequency in the Google Books Ngram corpus.The algorithm takes into account the discovered imbalance of the main literary styles-fiction, publicistics, and nonfiction.The rationale of the algorithm is given, as well as examples of correction.

Authors

Institutions

Publication Details

Journal
Computational Linguistics and Intellectual Technologies
Published
2025-01-01
DOI
https://doi.org/10.28995/2075-7182-2025-23-137-146
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Algorithm for Genre Imbalance Correction in the Russian Subcorpus of the Google Books Ngram Corpus

Anna Ivleva, Valery Solovyev
Computational Linguistics and Intellectual Technologies
Natural Language Processing Techniques
article

An Algorithm for Genre Imbalance Correction in the Russian Subcorpus of the Google Books Ngram Corpus

Anna Ivleva, Valery Solovyev
article en

Abstract

Recently, the latest version of the Google Books Ngram was shown to be imbalanced.This corpus being an important and widely used database, the imbalance can affect the results of research in different areas.In the paper, we present an algorithm for correcting the dynamics of word frequency in the Google Books Ngram corpus.The algorithm takes into account the discovered imbalance of the main literary styles-fiction, publicistics, and nonfiction.The rationale of the algorithm is given, as well as examples of correction.

Computational Linguistics and Intellectual Technologies
Kazan Federal University (RU)
Russian Science Foundation
Openalex Percentile: Top 88%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.