Research on the Construction of Topic Model in the Field of Digital Humanities Based on Sentence-BERT and LDA

In order to solve the problems that traditional methods cannot fully capture text semantic information in text topic recognition and sentence representation is not suitable for unsupervised learning, we use the Sentence-BERT model for sentence embedding tasks combined with the LDA model to construct a topic mining model, which provides new methods and ideas in the field of topic model construction methods. Firstly, the relevant literature was reviewed, then the text vectors were obtained by using Sentence-BERT and LDA models, and then the vectors of the two models were connected, and then the optimal number of clusters was judged, the clustering was carried out and the clustering effect was evaluated, and finally conduct comparative experiments. Through experiments on relevant literature data in the field of digital humanities, the model has a good effect on topic extraction, clear topic division, short calculation time, and it can effectively capture the features in the text.

Authors

Institutions

Publication Details

Published
2024-11-22
DOI
https://doi.org/10.1145/3722237.3722247
Primary Topic
Computational and Text Analysis Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on the Construction of Topic Model in the Field of Digital Humanities Based on Sentence-BERT and LDA

Honglei Li, Zhen Wang
Computational and Text Analysis Methods
article

Research on the Construction of Topic Model in the Field of Digital Humanities Based on Sentence-BERT and LDA

Honglei Li, Zhen Wang
article en

Abstract

In order to solve the problems that traditional methods cannot fully capture text semantic information in text topic recognition and sentence representation is not suitable for unsupervised learning, we use the Sentence-BERT model for sentence embedding tasks combined with the LDA model to construct a topic mining model, which provides new methods and ideas in the field of topic model construction methods. Firstly, the relevant literature was reviewed, then the text vectors were obtained by using Sentence-BERT and LDA models, and then the vectors of the two models were connected, and then the optimal number of clusters was judged, the clustering was carried out and the clustering effect was evaluated, and finally conduct comparative experiments. Through experiments on relevant literature data in the field of digital humanities, the model has a good effect on topic extraction, clear topic division, short calculation time, and it can effectively capture the features in the text.

Liaoning Normal University (CN)
Quality Education
Openalex Percentile: Top 48%
Computational and Text Analysis Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Research on the Construction of Topic Model in the Field of Digital Humanities Based on Sentence-BERT and LDA — Honglei Li, Zhen Wang · (2024) | TGRS Research Map | TGRS