Analysis of Clustering Algorithms with Explainable AI and Optimized Attributes of Flood Dataset

Clustering is one of the most popular unsupervised learning techniques in machine learning. It is used to recognize hidden patterns in data and group them accordingly. Data can be categorized using different clustering algorithms. However, there is no specific clustering algorithm that can be certified as the best in all cases. It is a matter of study which algorithm suits the best for a particular dataset. However, in contrast to the current literature, no study has been found to perform a cluster analysis based on a flood dataset, which has a significant impact on flood risk management. In this study, we have compared 10 clustering algorithms: k-means, bisecting k-means, fuzzy c-means, Gaussian mixture model (GMM), agglomerative, BIRCH, spectral, DBSCAN, OPTICS and mean shift according to 5 evaluation metrics: Rand index, silhouette score, Fowlkes-Mallows index, Davies-Bouldin index and Calinski-Harabasz index by applying them to a flood dataset in order to categorize data to identify flood. Moreover, optimal features from the flood dataset were selected based on random forest algorithm. The k-means is the best method for the dataset because it showed the best performance according to three of the five assessment measures. Furthermore, we extend our analysis to include the SHAP value analysis along with the means to interpret the results.

Authors

Institutions

Publication Details

Published
2024-12-20
DOI
https://doi.org/10.1109/iccit64611.2024.11022391
Primary Topic
Traffic Prediction and Management Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Analysis of Clustering Algorithms with Explainable AI and Optimized Attributes of Flood Dataset

Nusrat Sharmin, Syed M Rahman, Rubaba Hadiel Belal
1 links
Traffic Prediction and Management Techniques
article

Analysis of Clustering Algorithms with Explainable AI and Optimized Attributes of Flood Dataset

Nusrat Sharmin, Syed M Rahman, Rubaba Hadiel Belal
article en

Abstract

Clustering is one of the most popular unsupervised learning techniques in machine learning. It is used to recognize hidden patterns in data and group them accordingly. Data can be categorized using different clustering algorithms. However, there is no specific clustering algorithm that can be certified as the best in all cases. It is a matter of study which algorithm suits the best for a particular dataset. However, in contrast to the current literature, no study has been found to perform a cluster analysis based on a flood dataset, which has a significant impact on flood risk management. In this study, we have compared 10 clustering algorithms: k-means, bisecting k-means, fuzzy c-means, Gaussian mixture model (GMM), agglomerative, BIRCH, spectral, DBSCAN, OPTICS and mean shift according to 5 evaluation metrics: Rand index, silhouette score, Fowlkes-Mallows index, Davies-Bouldin index and Calinski-Harabasz index by applying them to a flood dataset in order to categorize data to identify flood. Moreover, optimal features from the flood dataset were selected based on random forest algorithm. The k-means is the best method for the dataset because it showed the best performance according to three of the five assessment measures. Furthermore, we extend our analysis to include the SHAP value analysis along with the means to interpret the results.

Dhaka University of Engineering & Technology (BD)
Climate action
Openalex Percentile: Top 69%
Traffic Prediction and Management Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Analysis of Clustering Algorithms with Explainable AI and Optimized Attributes of Flood Dataset — Nusrat Sharmin, Syed M Rahman, et al. · (2024) | TGRS Research Map | TGRS