SYSTEMATIZATION AND COMPARATIVE REVIEW OF TOPIC MODELING METRICS

This paper presents a systematic and comparative review of metrics used to assess the quality of topic models in natural language processing (NLP) tasks. Both traditional metrics, such as perplexity and topic coherence, and modern approaches, including word embedding tags (WETC) and graph methods, are considered. The advantages and limitations of each metric, as well as their applicability in various practical scenarios, are analyzed. Particular attention is paid to the criteria for choosing metrics depending on the modeling goal and the features of the text corpus. The work can be useful for researchers and developers seeking to improve the interpretability and accuracy of topic models.

Authors

Publication Details

Journal
SOFT MEASUREMENTS AND COMPUTING
Published
2025-01-01
DOI
https://doi.org/10.36871/2618-9976.2025.05.004
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

SYSTEMATIZATION AND COMPARATIVE REVIEW OF TOPIC MODELING METRICS

Iskander Akhmetov
SOFT MEASUREMENTS AND COMPUTING
Topic Modeling
article

SYSTEMATIZATION AND COMPARATIVE REVIEW OF TOPIC MODELING METRICS

Iskander Akhmetov
article en

Abstract

This paper presents a systematic and comparative review of metrics used to assess the quality of topic models in natural language processing (NLP) tasks. Both traditional metrics, such as perplexity and topic coherence, and modern approaches, including word embedding tags (WETC) and graph methods, are considered. The advantages and limitations of each metric, as well as their applicability in various practical scenarios, are analyzed. Particular attention is paid to the criteria for choosing metrics depending on the modeling goal and the features of the text corpus. The work can be useful for researchers and developers seeking to improve the interpretability and accuracy of topic models.

SOFT MEASUREMENTS AND COMPUTINGVol. 5(90)
Quality Education
Openalex Percentile: Top 93%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.