Aligning Sentences for Kazakh-Turkish Parallel Corpora
This paper presents a hybrid approach to sentence alignment for the Kazakh-Turkish parallel corpus, addressing the challenges posed by linguistic and structural differences between the two languages. The system is divided into two modules: the Hunaling module and the Rule-Based module. The Hunaling module first performs an initial alignment using sentence length to establish a rough correspondence between sentences. This is followed by a refinement stage that leverages lexical matching, focusing on Turkic cognates and shared roots. The Rule-Based module then applies syntactic and contextual rules to fine-tune the alignment, using a small annotated corpus to guide adjustments. The proposed approach achieves a precision of 90%, recall of 88%, and an F1-score of 88.5%, demonstrating significant improvements over traditional methods. This methodology offers a robust solution for aligning sentences in Kazakh-Turkish parallel corpora, with potential applications in machine translation and multilingual NLP.
Authors
- Aidana Karibayeva (ORCID: https://orcid.org/0000-0002-2023-1573)
- Eşref Adalı (ORCID: https://orcid.org/0000-0002-1561-8255)
- Diana Rakhimova (ORCID: https://orcid.org/0000-0003-1427-198X)
Institutions
- Al-Farabi Kazakh National University (KZ)
- Istanbul Technical University (TR)
Publication Details
- Published
- 2024-10-26
- DOI
- https://doi.org/10.1109/ubmk63289.2024.10773567
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00