Design of big data anomaly detection model based on random forest algorithm

Aiming at the problem that the anomaly detection process of big data is easily disturbed by edge data, resulting in poor accuracy of big data anomaly detection, a big data anomaly detection model based on random forest algorithm is proposed. Firstly, the improved -means algorithm is used to cluster the big data, and the principal component analysis method is used to extract the big data features; then, a big data anomaly detection model based on random forest classifier is constructed, the extracted features are input into the model, a decision tree is constructed, and the classification accuracy of the classifier is improved by dynamically updating the weight value of the decision tree; finally, the classification result is output to complete the anomaly detection of big data. The experimental results show that the detection time of the proposed model is about 25 s, the average accuracy of big data anomaly detection is, and the false alarm rate is .

Authors

Publication Details

Journal
Scientific insights and discoveries review
Published
2024-09-26
DOI
https://doi.org/10.59782/sidr.v1i1.40
Citations
3
Primary Topic
E-commerce and Technology Innovations
Type
article
Field-Weighted Citation Impact
2.03
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Design of big data anomaly detection model based on random forest algorithm

Fan Min, Song Shijun
3 citations
Scientific insights and discoveries review
E-commerce and Technology Innovations
2.03
article

Design of big data anomaly detection model based on random forest algorithm

Fan Min, Song Shijun
article en
3 citations

Abstract

Aiming at the problem that the anomaly detection process of big data is easily disturbed by edge data, resulting in poor accuracy of big data anomaly detection, a big data anomaly detection model based on random forest algorithm is proposed. Firstly, the improved -means algorithm is used to cluster the big data, and the principal component analysis method is used to extract the big data features; then, a big data anomaly detection model based on random forest classifier is constructed, the extracted features are input into the model, a decision tree is constructed, and the classification accuracy of the classifier is improved by dynamically updating the weight value of the decision tree; finally, the classification result is output to complete the anomaly detection of big data. The experimental results show that the detection time of the proposed model is about 25 s, the average accuracy of big data anomaly detection is, and the false alarm rate is .

Scientific insights and discoveries reviewVol. 1(1)
Openalex Percentile: Top 11%
E-commerce and Technology Innovations
2.03
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.