Aligning Sentences for Kazakh-Turkish Parallel Corpora

This paper presents a hybrid approach to sentence alignment for the Kazakh-Turkish parallel corpus, addressing the challenges posed by linguistic and structural differences between the two languages. The system is divided into two modules: the Hunaling module and the Rule-Based module. The Hunaling module first performs an initial alignment using sentence length to establish a rough correspondence between sentences. This is followed by a refinement stage that leverages lexical matching, focusing on Turkic cognates and shared roots. The Rule-Based module then applies syntactic and contextual rules to fine-tune the alignment, using a small annotated corpus to guide adjustments. The proposed approach achieves a precision of 90%, recall of 88%, and an F1-score of 88.5%, demonstrating significant improvements over traditional methods. This methodology offers a robust solution for aligning sentences in Kazakh-Turkish parallel corpora, with potential applications in machine translation and multilingual NLP.

Authors

Institutions

Publication Details

Published
2024-10-26
DOI
https://doi.org/10.1109/ubmk63289.2024.10773567
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Aligning Sentences for Kazakh-Turkish Parallel Corpora

Aidana Karibayeva, Eşref Adalı, Diana Rakhimova
Natural Language Processing Techniques
article

Aligning Sentences for Kazakh-Turkish Parallel Corpora

Aidana Karibayeva, Eşref Adalı, Diana Rakhimova
article en

Abstract

This paper presents a hybrid approach to sentence alignment for the Kazakh-Turkish parallel corpus, addressing the challenges posed by linguistic and structural differences between the two languages. The system is divided into two modules: the Hunaling module and the Rule-Based module. The Hunaling module first performs an initial alignment using sentence length to establish a rough correspondence between sentences. This is followed by a refinement stage that leverages lexical matching, focusing on Turkic cognates and shared roots. The Rule-Based module then applies syntactic and contextual rules to fine-tune the alignment, using a small annotated corpus to guide adjustments. The proposed approach achieves a precision of 90%, recall of 88%, and an F1-score of 88.5%, demonstrating significant improvements over traditional methods. This methodology offers a robust solution for aligning sentences in Kazakh-Turkish parallel corpora, with potential applications in machine translation and multilingual NLP.

Al-Farabi Kazakh National University (KZ), Istanbul Technical University (TR)
Reduced inequalities
Openalex Percentile: Top 79%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.