The Comparative Analysis of Hybrid Sampling, EasyEnsemble, and SVM-SMOTE Performance for Imbalanced Data Based on Bayesian Optimization

Imbalanced data represents a common challenge in classification modeling, as it can lead to prediction bias and reduce the models ability to correctly identify minority classes, which are often more critical. This study aims to compare the performance of three imbalance-handling techniquesHybrid Sampling, EasyEnsemble, and SVM-SMOTEapplied to the XGBoost classifier with hyperparameter tuning using Bayesian Optimization. A simulation study was conducted under a factorial completely randomized design involving three factors: class proportion (70:30, 80:20, 90:10), predictor variable types (10 categorical variables and a combination of 5 categorical and 5 numeric variables), and imbalance handling methods. Model performance was evaluated using balanced accuracy, sensitivity, and specificity. During the optimization process, 20 hyperparameter combinations were initially selected as prior evaluation points, followed by 20 additional optimization iterations to refine the search for the optimal hyperparameter configuration. The Bayesian Optimization process produced different optimal hyperparameter combinations for each simulation scenario, reflecting the distinct characteristics of the data under different experimental conditions. The analysis of variance revealed that both the main effects and the interactions among all factors significantly influenced classification performance. Among the evaluated methods, EasyEnsemble consistently achieved the best performance across all class imbalance scenarios. For all class proportions (70:30, 80:20, and 90:10), both in datasets consisting of 10 categorical predictor variables and in datasets comprising a combination of 5 categorical and 5 numerical predictor variables, EasyEnsemble achieved balanced accuracy, sensitivity, and specificity values consistently exceeding 0.90. Furthermore, Bayesian Optimization effectively enhanced the classification performance of XGBoost by efficiently identifying optimal hyperparameter configurations. Overall, the findings demonstrate that the combination of EasyEnsemble and Bayesian Optimization provides an effective approach for addressing class imbalance and improving classification performance.

Authors

Institutions

Publication Details

Journal
CAUCHY Jurnal Matematika Murni dan Aplikasi
Published
2026-11-16
DOI
https://doi.org/10.18860/cauchy.v11i2.42968
Primary Topic
Imbalanced Data Classification Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

The Comparative Analysis of Hybrid Sampling, EasyEnsemble, and SVM-SMOTE Performance for Imbalanced Data Based on Bayesian Optimization

Kusman Sadik, Megawati Zein Waliulu, Asep Saefuddin
4 links
CAUCHY Jurnal Matematika Murni dan Aplikasi
Imbalanced Data Classification Techniques
article

The Comparative Analysis of Hybrid Sampling, EasyEnsemble, and SVM-SMOTE Performance for Imbalanced Data Based on Bayesian Optimization

Kusman Sadik, Megawati Zein Waliulu, Asep Saefuddin
article en

Abstract

Imbalanced data represents a common challenge in classification modeling, as it can lead to prediction bias and reduce the models ability to correctly identify minority classes, which are often more critical. This study aims to compare the performance of three imbalance-handling techniquesHybrid Sampling, EasyEnsemble, and SVM-SMOTEapplied to the XGBoost classifier with hyperparameter tuning using Bayesian Optimization. A simulation study was conducted under a factorial completely randomized design involving three factors: class proportion (70:30, 80:20, 90:10), predictor variable types (10 categorical variables and a combination of 5 categorical and 5 numeric variables), and imbalance handling methods. Model performance was evaluated using balanced accuracy, sensitivity, and specificity. During the optimization process, 20 hyperparameter combinations were initially selected as prior evaluation points, followed by 20 additional optimization iterations to refine the search for the optimal hyperparameter configuration. The Bayesian Optimization process produced different optimal hyperparameter combinations for each simulation scenario, reflecting the distinct characteristics of the data under different experimental conditions. The analysis of variance revealed that both the main effects and the interactions among all factors significantly influenced classification performance. Among the evaluated methods, EasyEnsemble consistently achieved the best performance across all class imbalance scenarios. For all class proportions (70:30, 80:20, and 90:10), both in datasets consisting of 10 categorical predictor variables and in datasets comprising a combination of 5 categorical and 5 numerical predictor variables, EasyEnsemble achieved balanced accuracy, sensitivity, and specificity values consistently exceeding 0.90. Furthermore, Bayesian Optimization effectively enhanced the classification performance of XGBoost by efficiently identifying optimal hyperparameter configurations. Overall, the findings demonstrate that the combination of EasyEnsemble and Bayesian Optimization provides an effective approach for addressing class imbalance and improving classification performance.

CAUCHY Jurnal Matematika Murni dan AplikasiVol. 11(2)
IPB University (ID)
Lembaga Pengelola Dana Pendidikan
Imbalanced Data Classification Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon