Novel Association of Word Embeddings, PCA and K-means for Text Clustering

This paper addresses the problem of the increasing difficulty for users to find the information they want due to the explosive growth of documents on various topics in the modern web environment.Document clustering is a powerful tool that can improve the accessibility and usability of information by grouping documents with similar features, helping users quickly and easily find the information they need.In this paper, we proposed a novel method called PCA-KM (Principal Component Analysis -Kmeans) for document clustering.PCA-KM reduces dimensionality by applying principal component analysis to high-dimensional vectors of documents obtained from word embeddings, followed by the iterative application of modified K-means.Several clustering performance metrics were used to compare the proposed method with the traditional one, combining word embeddings and K-means.The results showed that the proposed method performed similarly or better on these metrics.Therefore, we expect that the proposed method will contribute to developing more efficient document retrieval services.

Authors

Publication Details

Journal
Asia-pacific Journal of Convergent Research Interchange
Published
2024-11-29
DOI
https://doi.org/10.47116/apjcri.2024.11.35
Primary Topic
Text and Document Classification Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Novel Association of Word Embeddings, PCA and K-means for Text Clustering

Gyemin Lee, Dong Hyun Kim
Asia-pacific Journal of Convergent Research Interchange
Text and Document Classification Technologies
article

Novel Association of Word Embeddings, PCA and K-means for Text Clustering

Gyemin Lee, Dong Hyun Kim
article en

Abstract

This paper addresses the problem of the increasing difficulty for users to find the information they want due to the explosive growth of documents on various topics in the modern web environment.Document clustering is a powerful tool that can improve the accessibility and usability of information by grouping documents with similar features, helping users quickly and easily find the information they need.In this paper, we proposed a novel method called PCA-KM (Principal Component Analysis -Kmeans) for document clustering.PCA-KM reduces dimensionality by applying principal component analysis to high-dimensional vectors of documents obtained from word embeddings, followed by the iterative application of modified K-means.Several clustering performance metrics were used to compare the proposed method with the traditional one, combining word embeddings and K-means.The results showed that the proposed method performed similarly or better on these metrics.Therefore, we expect that the proposed method will contribute to developing more efficient document retrieval services.

Asia-pacific Journal of Convergent Research InterchangeVol. 10(11)
Quality Education
Openalex Percentile: Top 80%
Text and Document Classification Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.