Performance Comparison of XGBoost and Naïve Bayes Algorithms Using SMOTE-Tomek for Diabetes Disease Classification

Diabetes mellitus remains a major global public health issue, including in Indonesia, where the rising number of cases requires accurate and timely prediction. Classification models often face challenges due to imbalanced datasets, which reduce their ability to detect minority classes. This study aims to compare the performance of the XGBoost and Naïve Bayes algorithms and to evaluate the effectiveness of the SMOTE-Tomek technique in handling class imbalance for diabetes classification. The dataset used is the Kaggle Diabetes Prediction Dataset, consisting of approximately 100,000 records with demographic and clinical attributes. The preprocessing stage includes label encoding, Min-Max normalization, and data balancing using SMOTE-Tomek. The dataset is then split into training and testing sets in an 80:20 ratio, and model performance is evaluated using accuracy, precision, recall, and F1 Score. The results show that XGBoost outperforms Naïve Bayes, achieving 97% accuracy, 88% precision, 72% recall, and 79% F1-score. Furthermore, the application of SMOTE-Tomek improves detection of the minority class, particularly recall, while slightly decreasing precision and F1-score. The combination of XGBoost and SMOTE-Tomek proves more effective at handling imbalanced data for early diabetes detection.

Authors

Institutions

Publication Details

Journal
MALCOM Indonesian Journal of Machine Learning and Computer Science
Published
2026-10-30
DOI
https://doi.org/10.57152/malcom.v6i4.2855
Primary Topic
Imbalanced Data Classification Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Performance Comparison of XGBoost and Naïve Bayes Algorithms Using SMOTE-Tomek for Diabetes Disease Classification

Wawan Firgiawan, Muh. Fuad Mansyur, Ayu Annisa Putri
4 links
MALCOM Indonesian Journal of Machine Learning and Computer Science
Imbalanced Data Classification Techniques
article

Performance Comparison of XGBoost and Naïve Bayes Algorithms Using SMOTE-Tomek for Diabetes Disease Classification

Wawan Firgiawan, Muh. Fuad Mansyur, Ayu Annisa Putri
article en

Abstract

Diabetes mellitus remains a major global public health issue, including in Indonesia, where the rising number of cases requires accurate and timely prediction. Classification models often face challenges due to imbalanced datasets, which reduce their ability to detect minority classes. This study aims to compare the performance of the XGBoost and Naïve Bayes algorithms and to evaluate the effectiveness of the SMOTE-Tomek technique in handling class imbalance for diabetes classification. The dataset used is the Kaggle Diabetes Prediction Dataset, consisting of approximately 100,000 records with demographic and clinical attributes. The preprocessing stage includes label encoding, Min-Max normalization, and data balancing using SMOTE-Tomek. The dataset is then split into training and testing sets in an 80:20 ratio, and model performance is evaluated using accuracy, precision, recall, and F1 Score. The results show that XGBoost outperforms Naïve Bayes, achieving 97% accuracy, 88% precision, 72% recall, and 79% F1-score. Furthermore, the application of SMOTE-Tomek improves detection of the minority class, particularly recall, while slightly decreasing precision and F1-score. The combination of XGBoost and SMOTE-Tomek proves more effective at handling imbalanced data for early diabetes detection.

MALCOM Indonesian Journal of Machine Learning and Computer Science
Universitas Sulawesi Barat (ID)
Good health and well-being, Reduced inequalities
Openalex Percentile: Top 14%
Imbalanced Data Classification Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon