DOES DATASET SPLITTING IMPACT ARABIC TEXT CLASSIFICATION MORE THAN PREPROCESSING? AN EMPIRICAL ANALYSIS IN BIG DATA ANALYTICS

Text classification in Arabic faces numerous challenges because of the difficult structure of Arabic morphology and the absence of agreement about dataset preparation methods and splitting techniques. Research studies mostly examine feature engineering and preprocessing techniques yet fail to investigate properly the relationship between dataset splitting proportions and classification results. Research analyzes how the ratios between training and testing datasets (10%-90%, 20%-80% and 30%-70%) affect classification outcomes together with normalization, stop word filtering before stem, and tokenize operations. Numerous evaluation tests are conducted using 111,728 documents extracted from three Arabic newspapers that cover topics related to sports, politics and culture, economy, and diversity. The evaluation includes six machine-learning algorithms which are Random Forest, Support Vector Machine (SVM), Logistic Regression, Naïve Bayes, K-Neighbors, and Decision Tree. The analysis shows that dividing the dataset impacts model performance more extensively than applying preprocessing to datasets especially when operating on large test sets. The application of genetic preprocessing resulted in minor accuracy enhancements for the Decision Tree model at +2.30% while it produced precision gains of +2.48% but SVM achieved only +0.64% sensitivity improvement through normalization techniques. Stemming and tokenization delivered the best preprocessing results because Arabic possesses numerous morphological forms. The data shows trained accuracy depends on well-managed training/testing splits, which creates an important contradiction regarding traditional preprocessing methods. This analysis adds meaningful value to Arabic text classification research by demonstrating quantitative data about the effect of dataset division techniques through practical recommendations for enhancing classification performance in big data analytics. The research results possess relevant applications in media organizations because they help optimize Arabic text processing in education systems while also enhancing business intelligence operations.

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-02-15
DOI
https://doi.org/10.5281/zenodo.15781706
Primary Topic
Text and Document Classification Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

DOES DATASET SPLITTING IMPACT ARABIC TEXT CLASSIFICATION MORE THAN PREPROCESSING? AN EMPIRICAL ANALYSIS IN BIG DATA ANALYTICS

Zenodo (CERN European Organization for Nuclear Research)
Text and Document Classification Technologies
article

DOES DATASET SPLITTING IMPACT ARABIC TEXT CLASSIFICATION MORE THAN PREPROCESSING? AN EMPIRICAL ANALYSIS IN BIG DATA ANALYTICS

article en

Abstract

Text classification in Arabic faces numerous challenges because of the difficult structure of Arabic morphology and the absence of agreement about dataset preparation methods and splitting techniques. Research studies mostly examine feature engineering and preprocessing techniques yet fail to investigate properly the relationship between dataset splitting proportions and classification results. Research analyzes how the ratios between training and testing datasets (10%-90%, 20%-80% and 30%-70%) affect classification outcomes together with normalization, stop word filtering before stem, and tokenize operations. Numerous evaluation tests are conducted using 111,728 documents extracted from three Arabic newspapers that cover topics related to sports, politics and culture, economy, and diversity. The evaluation includes six machine-learning algorithms which are Random Forest, Support Vector Machine (SVM), Logistic Regression, Naïve Bayes, K-Neighbors, and Decision Tree. The analysis shows that dividing the dataset impacts model performance more extensively than applying preprocessing to datasets especially when operating on large test sets. The application of genetic preprocessing resulted in minor accuracy enhancements for the Decision Tree model at +2.30% while it produced precision gains of +2.48% but SVM achieved only +0.64% sensitivity improvement through normalization techniques. Stemming and tokenization delivered the best preprocessing results because Arabic possesses numerous morphological forms. The data shows trained accuracy depends on well-managed training/testing splits, which creates an important contradiction regarding traditional preprocessing methods. This analysis adds meaningful value to Arabic text classification research by demonstrating quantitative data about the effect of dataset division techniques through practical recommendations for enhancing classification performance in big data analytics. The research results possess relevant applications in media organizations because they help optimize Arabic text processing in education systems while also enhancing business intelligence operations.

Zenodo (CERN European Organization for Nuclear Research)
Quality Education
Openalex Percentile: Top 75%
Text and Document Classification Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.