Parallel density clustering algorithm based on MapReduce and optimized cuckoo algorithm

In the process of parallel density clustering, the boundary points of clusters with different densities are blurred and there is data noise, which affects the clustering performance and makes the clustering results subject to the influence of local optimality. A parallel density clustering algorithm based on MapReduce and optimized cuckoo algorithm is proposed to solve the problem. Firstly, the algorithm combines the nearest neighbor and inverse nearest neighbor strategies in -means (DBSCAN), and redefines the expansion conditions of clusters in the density-based spatial dutering of apps with noise (DBSCAN) algorithm by calculating the influence space of each data point, avoiding the problem of fuzzy division of boundary points of clusters with different densities; secondly, a feasible iterative noise point processing strategy is proposed by combining the nearest neighbor idea in KDBSCAN density clustering, which reduces the impact of noise points in the data on the performance of clustering algorithms; thirdly, an optimization and improvement strategy MCS (Majorization cuckoo search) based on the traditional cuckoo algorithm is proposed, which attenuates the weight of the probability of finding the nest and improves the algorithm convergence speed as the number of iterative searches increases, solving the problem that the clustering results are constrained by local optimality; finally, a parallel density clustering strategy MCS-KDBSCAN is proposed in combination with MapReduce, which reduces the communication burden of transmitting the local optimal solution of the parallel clustering algorithm by parallelizing the density clustering algorithm operation and improves the algorithm performance. Experiments show that the proposed MCS-KDBSCAN parallel density clustering algorithm is superior in terms of clustering accuracy and clustering running time.

Authors

Publication Details

Journal
Scientific insights and discoveries review
Published
2024-09-26
DOI
https://doi.org/10.59782/sidr.v1i1.32
Primary Topic
Data Mining Algorithms and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Parallel density clustering algorithm based on MapReduce and optimized cuckoo algorithm

Yimin Mao, Gu Senqing
Scientific insights and discoveries review
Data Mining Algorithms and Applications
article

Parallel density clustering algorithm based on MapReduce and optimized cuckoo algorithm

Yimin Mao, Gu Senqing
article en

Abstract

In the process of parallel density clustering, the boundary points of clusters with different densities are blurred and there is data noise, which affects the clustering performance and makes the clustering results subject to the influence of local optimality. A parallel density clustering algorithm based on MapReduce and optimized cuckoo algorithm is proposed to solve the problem. Firstly, the algorithm combines the nearest neighbor and inverse nearest neighbor strategies in -means (DBSCAN), and redefines the expansion conditions of clusters in the density-based spatial dutering of apps with noise (DBSCAN) algorithm by calculating the influence space of each data point, avoiding the problem of fuzzy division of boundary points of clusters with different densities; secondly, a feasible iterative noise point processing strategy is proposed by combining the nearest neighbor idea in KDBSCAN density clustering, which reduces the impact of noise points in the data on the performance of clustering algorithms; thirdly, an optimization and improvement strategy MCS (Majorization cuckoo search) based on the traditional cuckoo algorithm is proposed, which attenuates the weight of the probability of finding the nest and improves the algorithm convergence speed as the number of iterative searches increases, solving the problem that the clustering results are constrained by local optimality; finally, a parallel density clustering strategy MCS-KDBSCAN is proposed in combination with MapReduce, which reduces the communication burden of transmitting the local optimal solution of the parallel clustering algorithm by parallelizing the density clustering algorithm operation and improves the algorithm performance. Experiments show that the proposed MCS-KDBSCAN parallel density clustering algorithm is superior in terms of clustering accuracy and clustering running time.

Scientific insights and discoveries reviewVol. 1(1)
Openalex Percentile: Top 75%
Data Mining Algorithms and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.