New Approach Based on the Ensemble Learning Estimator to Maximize Accuracy

The objective of this article is to contribute to the development and optimization of ensemble models in machine learning by proposing an innovative method based on homogeneous and heterogeneous families of algorithms. This approach aims to improve the model's generalization and reduce the bias-variance tradeoff, with the ambition of achieving more accurate and robust predictions. To illustrate this approach, we rely on proven techniques such as Random Forest, which is based on the principle of Bagging (Bootstrap Aggregating) to reduce the model's variance, as well as AdaBoost and Gradient Boosting, which belong to the family of sequential ensemble methods that utilize dynamic weighting and gradient descent to progressively correct errors. Additionally, other approaches from supervised and unsupervised learning, such as Support Vector Machines (SVM) for classification, K-means for clustering, and Artificial Neural Networks (ANN), enrich this algorithmic landscape. The central idea of our method is to intelligently combine several ensemble models by applying strategies such as Stacking and Blending to optimize errors at each iteration and enhance the model's generalization capacity. As the saying goes, "unity is strength." This maxim is particularly relevant in the context of building a hybrid machine learning model, as it highlights the importance of collaboration among different classes of algorithms to achieve optimal results. By integrating these various approaches under a unified architecture, we aspire to design a robust ensemble model capable of adapting to the complexity of big data and providing accurate and reliable predictions in a highly variable environment.

Authors

Institutions

Publication Details

Journal
Journal of Advances in Mathematics and Computer Science
Published
2025-02-20
DOI
https://doi.org/10.9734/jamcs/2025/v40i31976
Primary Topic
Sensor Technology and Measurement Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

New Approach Based on the Ensemble Learning Estimator to Maximize Accuracy

Pierre Kafunda Katalay, Lady NLANDU MABUMBI, Gédéon KANGA SALU, Richard KITONDUA LUBANZADIO et al.
Journal of Advances in Mathematics and Computer Science
Sensor Technology and Measurement Systems
article

New Approach Based on the Ensemble Learning Estimator to Maximize Accuracy

Pierre Kafunda Katalay, Lady NLANDU MABUMBI, Gédéon KANGA SALU, Richard KITONDUA LUBANZADIO, Guylit KIALA LUTUMBA, Gladys NABADIATA MBALA, Arnold KIALA WA KIALA, Grace PEMBELE NTUMBA, Valery LUKEKA BYEMBA, Hugo KISOMBE NDOMBELE
article en

Abstract

The objective of this article is to contribute to the development and optimization of ensemble models in machine learning by proposing an innovative method based on homogeneous and heterogeneous families of algorithms. This approach aims to improve the model's generalization and reduce the bias-variance tradeoff, with the ambition of achieving more accurate and robust predictions. To illustrate this approach, we rely on proven techniques such as Random Forest, which is based on the principle of Bagging (Bootstrap Aggregating) to reduce the model's variance, as well as AdaBoost and Gradient Boosting, which belong to the family of sequential ensemble methods that utilize dynamic weighting and gradient descent to progressively correct errors. Additionally, other approaches from supervised and unsupervised learning, such as Support Vector Machines (SVM) for classification, K-means for clustering, and Artificial Neural Networks (ANN), enrich this algorithmic landscape. The central idea of our method is to intelligently combine several ensemble models by applying strategies such as Stacking and Blending to optimize errors at each iteration and enhance the model's generalization capacity. As the saying goes, "unity is strength." This maxim is particularly relevant in the context of building a hybrid machine learning model, as it highlights the importance of collaboration among different classes of algorithms to achieve optimal results. By integrating these various approaches under a unified architecture, we aspire to design a robust ensemble model capable of adapting to the complexity of big data and providing accurate and reliable predictions in a highly variable environment.

Journal of Advances in Mathematics and Computer ScienceVol. 40(3)
University of Kinshasa (CD), Université Pédagogique Nationale (CD)
Openalex Percentile: Top 97%
Sensor Technology and Measurement Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.