Urdu to English-Based Unsupervised Machine Translation

Machine Translation (MT) is a subfield of computational linguistics. The two primary state-of-the-art approaches in MT are Neural Machine Translation (NMT) and Statistical Machine Translation (SMT), both of which require large corpora for training. Urdu counts in low-resource languages due to the fewer resources available for computational work. To build a good translation system, the resources available are not enough. Many languages present in the world have a different structure. Like in Urdu and English, the Urdu structure is based on Subject-Object-Verb (SOV), and the English structure is based on Subject-Verb-Object (SVO). This paper proposes a new method of Urdu-to-English unsupervised translation to overcome one of the biggest obstacles in low-resource languages. The importance of this work is found in the lack of remedies in case of no parallel corpora, especially in structurally differing languages. Possible uses of this model can be extended across integrating two languages, particularly Urdu and English for producing NLP applications such as hate speech detection, opinion mining, and information search in multilingual contexts. We used Tanzil Corpus for Unsupervised Neural Machine Translation model training. From the on-the-fly backtranslation model we obtain the BLEU score of 5.21 and with the supervised technique obtain the BLEU score of 13.85 for Urdu to English language pair. We faced many problems, especially in organizing the text alignments due to the difference in language structures of Urdu (SOV) and English (SVO). However, the preprocessing required in this case was the tokenization, the true casing, and the punctuation differences between the languages.

Authors

Institutions

Publication Details

Journal
Journal of Computational Science and Applications (JCSA) ISSN 3079-0867 (Onilne)
Published
2024-12-01
DOI
https://doi.org/10.51846/jcsa.v1i2.3536
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Urdu to English-Based Unsupervised Machine Translation

Komal Saleem, Amna Sarwar, Muhammad M. Hussain, Usama Ahmed et al.
Journal of Computational Science and Applications (JCSA) ISSN 3079-0867 (Onilne)
Natural Language Processing Techniques
article

Urdu to English-Based Unsupervised Machine Translation

Komal Saleem, Amna Sarwar, Muhammad M. Hussain, Usama Ahmed, Ahmed Raza
article en

Abstract

Machine Translation (MT) is a subfield of computational linguistics. The two primary state-of-the-art approaches in MT are Neural Machine Translation (NMT) and Statistical Machine Translation (SMT), both of which require large corpora for training. Urdu counts in low-resource languages due to the fewer resources available for computational work. To build a good translation system, the resources available are not enough. Many languages present in the world have a different structure. Like in Urdu and English, the Urdu structure is based on Subject-Object-Verb (SOV), and the English structure is based on Subject-Verb-Object (SVO). This paper proposes a new method of Urdu-to-English unsupervised translation to overcome one of the biggest obstacles in low-resource languages. The importance of this work is found in the lack of remedies in case of no parallel corpora, especially in structurally differing languages. Possible uses of this model can be extended across integrating two languages, particularly Urdu and English for producing NLP applications such as hate speech detection, opinion mining, and information search in multilingual contexts. We used Tanzil Corpus for Unsupervised Neural Machine Translation model training. From the on-the-fly backtranslation model we obtain the BLEU score of 5.21 and with the supervised technique obtain the BLEU score of 13.85 for Urdu to English language pair. We faced many problems, especially in organizing the text alignments due to the difference in language structures of Urdu (SOV) and English (SVO). However, the preprocessing required in this case was the tokenization, the true casing, and the punctuation differences between the languages.

Journal of Computational Science and Applications (JCSA) ISSN 3079-0867 (Onilne)Vol. 1(2)
COMSATS University Islamabad (PK), University of Wah (PK), University of South Asia (PK), University of Management and Technology (PK)
Openalex Percentile: Top 74%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.