TEXT MINING AND SENTIMENT ANALYSIS FOR UZBEK: EVALUATING SVM AND NAIVE BAYES FOR UNDER-RESOURCED LANGUAGE PROCESSING

This study explores the application of text mining techniques to classify and analyze Uzbek text, focusing on the performance of Support Vector Machine (SVM) and Naive Bayes algorithms. Due to the unique linguistic structure of Uzbek, an under-resourced language with an agglutinative morphology and dual-script usage (Cyrillic and Latin), text mining presents several challenges. We collected a dataset from various Uzbek text sources, including news articles and social media posts, and applied customized preprocessing steps such as script normalization, tokenization, and stop word removal.The processed text was represented using Term Frequency-Inverse Document Frequency (TF-IDF) features with n-grams to capture contextual nuances. Both SVM and Naive Bayes classifiers were trained on the dataset and evaluated using accuracy, precision, recall, and F1-score metrics. SVM demonstrated higher accuracy and precision, making it well-suited for tasks requiring specificity, while Naive Bayes showed robustness in recall, effectively capturing diverse linguistic patterns.Our findings indicate that both models, with tailored preprocessing, can effectively handle Uzbek’s morphological and syntactic features. However, each model has distinct strengths: SVM excels in handling high-dimensional, well-preprocessed data, while Naive Bayes is more resilient to informal and morphologically diverse language contexts. Future research directions include integrating ensemble models, exploring deep learning approaches, and expanding resources for Uzbek NLP to improve model accuracy and adaptability further. This work contributes to advancing natural language processing for under-resourced languages, providing insights into efficient text mining techniques for Uzbek.

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2024-12-23
DOI
https://doi.org/10.5281/zenodo.14646365
Primary Topic
Text and Document Classification Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

TEXT MINING AND SENTIMENT ANALYSIS FOR UZBEK: EVALUATING SVM AND NAIVE BAYES FOR UNDER-RESOURCED LANGUAGE PROCESSING

Zenodo (CERN European Organization for Nuclear Research)
Text and Document Classification Technologies
article

TEXT MINING AND SENTIMENT ANALYSIS FOR UZBEK: EVALUATING SVM AND NAIVE BAYES FOR UNDER-RESOURCED LANGUAGE PROCESSING

article en

Abstract

This study explores the application of text mining techniques to classify and analyze Uzbek text, focusing on the performance of Support Vector Machine (SVM) and Naive Bayes algorithms. Due to the unique linguistic structure of Uzbek, an under-resourced language with an agglutinative morphology and dual-script usage (Cyrillic and Latin), text mining presents several challenges. We collected a dataset from various Uzbek text sources, including news articles and social media posts, and applied customized preprocessing steps such as script normalization, tokenization, and stop word removal.The processed text was represented using Term Frequency-Inverse Document Frequency (TF-IDF) features with n-grams to capture contextual nuances. Both SVM and Naive Bayes classifiers were trained on the dataset and evaluated using accuracy, precision, recall, and F1-score metrics. SVM demonstrated higher accuracy and precision, making it well-suited for tasks requiring specificity, while Naive Bayes showed robustness in recall, effectively capturing diverse linguistic patterns.Our findings indicate that both models, with tailored preprocessing, can effectively handle Uzbek’s morphological and syntactic features. However, each model has distinct strengths: SVM excels in handling high-dimensional, well-preprocessed data, while Naive Bayes is more resilient to informal and morphologically diverse language contexts. Future research directions include integrating ensemble models, exploring deep learning approaches, and expanding resources for Uzbek NLP to improve model accuracy and adaptability further. This work contributes to advancing natural language processing for under-resourced languages, providing insights into efficient text mining techniques for Uzbek.

Zenodo (CERN European Organization for Nuclear Research)
Quality Education
Openalex Percentile: Top 68%
Text and Document Classification Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

TEXT MINING AND SENTIMENT ANALYSIS FOR UZBEK: EVALUATING SVM AND NAIVE BAYES FOR UNDER-RESOURCED LANGUAGE PROCESSING · Zenodo (CERN European Organization for Nuclear Research) (2024) | TGRS Research Map | TGRS