A comparative empirical evaluation of semantic clustering algorithms on static word embeddings

• K-means with GloVe embeddings yields the most semantically coherent clusters. • DBSCAN performs best for identifying outliers but underperforms in thematic clustering. • Embedding model selection has a stronger impact than algorithm choice on cluster quality. • GloVe is optimal for taxonomy development, while Wiki captures broader thematic patterns. This study conducts a comprehensive empirical evaluation of semantic clustering algorithms to identify the most effective approach for automatically organizing and extracting meaning from textual data. By systematically comparing the performance of K-means, K-medoids, and DBSCAN on word embeddings from GloVe and Wiki models, it provides data-driven insights for optimizing Natural Language Processing (NLP) pipelines in information management systems. The research suggests a practical framework for selecting clustering algorithms and embedding models based on specific operational objectives, such as document clustering, knowledge base construction, and content-based recommendation. The investigation employed a two-phase methodology. Initially, predefined word lists were transformed into numerical vectors using pre-trained GloVe and Wiki models. K-means, K-medoids, and DBSCAN algorithms were applied, with performance evaluated via Silhouette Score and Davies-Bouldin Index, complemented by Principal Component Analysis (PCA) for visualization. Results were benchmarked against manually curated semantic groupings. Subsequently, the findings were validated on a large-scale corpus of 303 research articles to assess scalability and real-world applicability. Analysis indicates that, under the evaluated configurations, K-means combined with GloVe embeddings produced comparatively higher semantic coherence and more interpretable cluster structures than the alternative methods considered. K-medoids demonstrated robustness against outliers but yielded less compact groupings. While DBSCAN indicated effective for outlier identification, it consistently underperformed in forming semantically meaningful clusters. The GloVe model significantly outperformed Wiki embeddings in generating precise and interpretable clusters, whereas Wiki produced broader, less distinct groupings. Large-scale validation confirmed these results, with K-means successfully identifying dominant research themes, including digital library adoption (43.2%), reference services (15.2%), and research data management (8.9%)—in a corpus of academic literature. Under the evaluated corpus characteristics and parameter settings, DBSCAN classified most documents as outliers, indicating limited suitability for this specific balanced document collection. K-means and K-medoids emerge as comparatively effective algorithms under the evaluated conditions. The study underscores the critical influence of vector representation models, with GloVe embeddings providing superior semantic distinction compared to Wiki. These findings offer clear, actionable guidance for selecting clustering methods in NLP applications, highlighting the necessity of aligning algorithmic choice with specific dataset characteristics and information management goals. This research moves beyond theoretical descriptions by delivering a rigorous, empirical comparison that elucidates the crucial interaction between algorithm selection and embedding models for semantic tasks. The findings provide practitioners with a context-dependent decision matrix: K-means with GloVe is effective under the studied conditions for taxonomy development and thematic categorization, whereas DBSCAN is preferable for outlier detection in noisy data. By demonstrating that GloVe's global statistical approach yields more distinct clusters than Wiki's contextual model for this purpose, the study contributes a practical, evidence-based framework for enhancing semantic analysis in real-world information systems.

Authors

Institutions

Publication Details

Journal
International Journal of Information Management Data Insights
Published
2026-03-11
DOI
https://doi.org/10.1016/j.jjimei.2026.100396
Primary Topic
Advanced Clustering Algorithms Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A comparative empirical evaluation of semantic clustering algorithms on static word embeddings

Asefeh Asemi, Rajab Kiani Shahvandy, Mahdi Houshangi
International Journal of Information Management Data Insights
Advanced Clustering Algorithms Research
article

A comparative empirical evaluation of semantic clustering algorithms on static word embeddings

Asefeh Asemi, Rajab Kiani Shahvandy, Mahdi Houshangi
article en

Abstract

• K-means with GloVe embeddings yields the most semantically coherent clusters. • DBSCAN performs best for identifying outliers but underperforms in thematic clustering. • Embedding model selection has a stronger impact than algorithm choice on cluster quality. • GloVe is optimal for taxonomy development, while Wiki captures broader thematic patterns. This study conducts a comprehensive empirical evaluation of semantic clustering algorithms to identify the most effective approach for automatically organizing and extracting meaning from textual data. By systematically comparing the performance of K-means, K-medoids, and DBSCAN on word embeddings from GloVe and Wiki models, it provides data-driven insights for optimizing Natural Language Processing (NLP) pipelines in information management systems. The research suggests a practical framework for selecting clustering algorithms and embedding models based on specific operational objectives, such as document clustering, knowledge base construction, and content-based recommendation. The investigation employed a two-phase methodology. Initially, predefined word lists were transformed into numerical vectors using pre-trained GloVe and Wiki models. K-means, K-medoids, and DBSCAN algorithms were applied, with performance evaluated via Silhouette Score and Davies-Bouldin Index, complemented by Principal Component Analysis (PCA) for visualization. Results were benchmarked against manually curated semantic groupings. Subsequently, the findings were validated on a large-scale corpus of 303 research articles to assess scalability and real-world applicability. Analysis indicates that, under the evaluated configurations, K-means combined with GloVe embeddings produced comparatively higher semantic coherence and more interpretable cluster structures than the alternative methods considered. K-medoids demonstrated robustness against outliers but yielded less compact groupings. While DBSCAN indicated effective for outlier identification, it consistently underperformed in forming semantically meaningful clusters. The GloVe model significantly outperformed Wiki embeddings in generating precise and interpretable clusters, whereas Wiki produced broader, less distinct groupings. Large-scale validation confirmed these results, with K-means successfully identifying dominant research themes, including digital library adoption (43.2%), reference services (15.2%), and research data management (8.9%)—in a corpus of academic literature. Under the evaluated corpus characteristics and parameter settings, DBSCAN classified most documents as outliers, indicating limited suitability for this specific balanced document collection. K-means and K-medoids emerge as comparatively effective algorithms under the evaluated conditions. The study underscores the critical influence of vector representation models, with GloVe embeddings providing superior semantic distinction compared to Wiki. These findings offer clear, actionable guidance for selecting clustering methods in NLP applications, highlighting the necessity of aligning algorithmic choice with specific dataset characteristics and information management goals. This research moves beyond theoretical descriptions by delivering a rigorous, empirical comparison that elucidates the crucial interaction between algorithm selection and embedding models for semantic tasks. The findings provide practitioners with a context-dependent decision matrix: K-means with GloVe is effective under the studied conditions for taxonomy development and thematic categorization, whereas DBSCAN is preferable for outlier detection in noisy data. By demonstrating that GloVe's global statistical approach yields more distinct clusters than Wiki's contextual model for this purpose, the study contributes a practical, evidence-based framework for enhancing semantic analysis in real-world information systems.

International Journal of Information Management Data InsightsVol. 6(1)
Corvinus University of Budapest (HU), University of Isfahan (IR), Technical University of Munich (DE)
Quality Education
Openalex Percentile: Top 29%
Advanced Clustering Algorithms Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.