An Enhanced Random Forest Algorithm Based on Spatial Partitioning and Weighted Voting Mechanism
Random Forest is an efficient machine learning classification algorithm known for its high accuracy and interpretability. However, the traditional voting mechanism in the standard Random Forest algorithm assigns equal voting power to all decision trees, regardless of their training accuracy, which can reduce overall model performance. To address this issue without overemphasizing individual trees through direct weighting, this paper proposes an enhanced Random Forest algorithm based on spatial partitioning and a weighted voting mechanism. The proposed method partitions the entire feature space, and within each subspace, a relative majority voting mechanism is applied. Additionally, a validation set is used to assign weights to each subspace, taking into account the differences between strong and weak classifiers. Experimental results on publicly available datasets demonstrate that the proposed algorithm outperforms the traditional Random Forest, SVM, and KNN classifiers in terms of classification accuracy and recall.
Authors
- Mei Wang (ORCID: https://orcid.org/0000-0002-9121-3321)
Institutions
- Institute of Software (CN)
- China University of Petroleum, East China (CN)
Publication Details
- Published
- 2024-12-13
- DOI
- https://doi.org/10.1109/icftic64248.2024.10913242
- Primary Topic
- Internet Traffic Analysis and Secure E-voting
- Type
- article
- Field-Weighted Citation Impact
- 0.00