Development of a Framework for Analyzing Kazakh Language Errors in Semi-Structured Data

This paper presents a novel hybrid framework for systematic error analysis in semi-structured Kazakh texts, addressing the dual challenges of rich agglutinative morphology and low-resource data environments. The proposed pipeline integrates deterministic linguistic rules derived from the Apertium Turkic lexicon with probabilistic classifiers trained on an iteratively expanded corpus of 120 198 sentences. Core components include text normalization, tokenization, lexicon lookup, morphological parsing, and error classification, each formalized through mathematical functions to ensure reproducibility. Empirical evaluation against baseline systems demonstrated an F₁-score improvement of 12 percentage points, with preprocessing accuracy rising from 89 % to 96 % following successive lexicon augmentations. Cross-platform analysis of 3 000 records revealed that Russian-spelling interference accounts for nearly half of all detected errors, whereas typographical and pure spelling mistakes vary substantially across user-generated and editorial sources. Comprehensive linguistic resources—comprising over 70 000 root forms, 5 136 affix entries, and a validated correct-word dictionary—were compiled to underpin robust error detection. While manual lexicon enrichment proved effective, its labor intensity suggests the need for semi-supervised morphological induction in future work. Overall, this study establishes a scalable, adaptable approach for error analysis in agglutinative languages and lays the groundwork for extending these methods to other Turkic language contexts.

Authors

Institutions

Publication Details

Journal
Procedia Computer Science
Published
2025-01-01
DOI
https://doi.org/10.1016/j.procs.2025.08.260
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Development of a Framework for Analyzing Kazakh Language Errors in Semi-Structured Data

Сакен Мамбетов, Laura Baitenova, Gaukhar Munaitbas, Saule Tussupova
Procedia Computer Science
Natural Language Processing Techniques
article

Development of a Framework for Analyzing Kazakh Language Errors in Semi-Structured Data

Сакен Мамбетов, Laura Baitenova, Gaukhar Munaitbas, Saule Tussupova
article en

Abstract

This paper presents a novel hybrid framework for systematic error analysis in semi-structured Kazakh texts, addressing the dual challenges of rich agglutinative morphology and low-resource data environments. The proposed pipeline integrates deterministic linguistic rules derived from the Apertium Turkic lexicon with probabilistic classifiers trained on an iteratively expanded corpus of 120 198 sentences. Core components include text normalization, tokenization, lexicon lookup, morphological parsing, and error classification, each formalized through mathematical functions to ensure reproducibility. Empirical evaluation against baseline systems demonstrated an F₁-score improvement of 12 percentage points, with preprocessing accuracy rising from 89 % to 96 % following successive lexicon augmentations. Cross-platform analysis of 3 000 records revealed that Russian-spelling interference accounts for nearly half of all detected errors, whereas typographical and pure spelling mistakes vary substantially across user-generated and editorial sources. Comprehensive linguistic resources—comprising over 70 000 root forms, 5 136 affix entries, and a validated correct-word dictionary—were compiled to underpin robust error detection. While manual lexicon enrichment proved effective, its labor intensity suggests the need for semi-supervised morphological induction in future work. Overall, this study establishes a scalable, adaptable approach for error analysis in agglutinative languages and lays the groundwork for extending these methods to other Turkic language contexts.

Procedia Computer ScienceVol. 269
Turan University (KZ)
Openalex Percentile: Top 83%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.