Development of a Framework for Analyzing Kazakh Language Errors in Semi-Structured Data
This paper presents a novel hybrid framework for systematic error analysis in semi-structured Kazakh texts, addressing the dual challenges of rich agglutinative morphology and low-resource data environments. The proposed pipeline integrates deterministic linguistic rules derived from the Apertium Turkic lexicon with probabilistic classifiers trained on an iteratively expanded corpus of 120 198 sentences. Core components include text normalization, tokenization, lexicon lookup, morphological parsing, and error classification, each formalized through mathematical functions to ensure reproducibility. Empirical evaluation against baseline systems demonstrated an F₁-score improvement of 12 percentage points, with preprocessing accuracy rising from 89 % to 96 % following successive lexicon augmentations. Cross-platform analysis of 3 000 records revealed that Russian-spelling interference accounts for nearly half of all detected errors, whereas typographical and pure spelling mistakes vary substantially across user-generated and editorial sources. Comprehensive linguistic resources—comprising over 70 000 root forms, 5 136 affix entries, and a validated correct-word dictionary—were compiled to underpin robust error detection. While manual lexicon enrichment proved effective, its labor intensity suggests the need for semi-supervised morphological induction in future work. Overall, this study establishes a scalable, adaptable approach for error analysis in agglutinative languages and lays the groundwork for extending these methods to other Turkic language contexts.
Authors
- Сакен Мамбетов (ORCID: https://orcid.org/0000-0002-7249-5378)
- Laura Baitenova
- Gaukhar Munaitbas
- Saule Tussupova
Institutions
- Turan University (KZ)
Publication Details
- Journal
- Procedia Computer Science
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1016/j.procs.2025.08.260
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00