An <scp>SBERT</scp> ‐ <scp>LDA</scp> Framework With <scp>FADC</scp> ‐Based Semantic Aggregation for Short‐Text Topic Modeling of Online Public Opinion on Energy Enterprises

ABSTRACT With the rapid growth of digital social media, identifying hot topics in online public opinion has become important for public opinion monitoring and risk management in the energy sector. Latent Dirichlet allocation (LDA) has been widely used for topic discovery on social media platforms such as Weibo. However, traditional LDA‐based methods often face challenges when applied to short texts because individual posts contain limited word co‐occurrence information. In addition, the bag‐of‐words representation used by LDA limits its ability to capture contextual semantic relationships. To address these problems, this study proposes an SBERT‐LDA framework for short‐text topic modeling of online public opinion related to energy enterprises. The framework uses sentence‐BERT (SBERT) to capture sentence‐level semantic similarity and introduces a fast adaptive density clustering (FADC) algorithm to construct semantically coherent and size‐controllable pseudo‐documents. These pseudo‐documents enrich the document‐level word co‐occurrence context available to LDA, thereby alleviating short‐text sparsity while indirectly incorporating semantic information into the LDA‐based topic modeling process. Dimensionality reduction is further applied to improve the efficiency of clustering high‐dimensional embeddings. Extensive experiments were conducted on a large‐scale Weibo dataset related to Chinese energy enterprises, with additional validation on the public TNEWS benchmark. The results show that the proposed framework generates coherent and interpretable topics while maintaining competitive topic diversity. Ablation studies, FADC analysis, and human‐in‐the‐loop evaluation further support the effectiveness, efficiency, and interpretability of the framework. Applied to energy‐enterprise‐related Weibo posts, the SBERT‐LDA framework identified five distinct hot topics, ranging from corporate finance and stock market trends to new energy technologies, oil and gas markets, and energy infrastructure, providing useful insights for strategic public opinion analysis.

Authors

Institutions

Publication Details

Journal
Concurrency and Computation Practice and Experience
Published
2026-07-22
DOI
https://doi.org/10.1002/cpe.70874
Primary Topic
Computational and Text Analysis Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An SBERT ‐ LDA Framework With FADC ‐Based Semantic Aggregation for Short‐Text Topic Modeling of Online Public Opinion on Energy Enterprises

Chun Liu, C W Wang, Yi-Xiang Wang, Yibo Zhao et al.
Concurrency and Computation Practice and Experience
Computational and Text Analysis Methods
article

An SBERT ‐ LDA Framework With FADC ‐Based Semantic Aggregation for Short‐Text Topic Modeling of Online Public Opinion on Energy Enterprises

Chun Liu, C W Wang, Yi-Xiang Wang, Yibo Zhao, Jiaen Shangguan
article en

Abstract

ABSTRACT With the rapid growth of digital social media, identifying hot topics in online public opinion has become important for public opinion monitoring and risk management in the energy sector. Latent Dirichlet allocation (LDA) has been widely used for topic discovery on social media platforms such as Weibo. However, traditional LDA‐based methods often face challenges when applied to short texts because individual posts contain limited word co‐occurrence information. In addition, the bag‐of‐words representation used by LDA limits its ability to capture contextual semantic relationships. To address these problems, this study proposes an SBERT‐LDA framework for short‐text topic modeling of online public opinion related to energy enterprises. The framework uses sentence‐BERT (SBERT) to capture sentence‐level semantic similarity and introduces a fast adaptive density clustering (FADC) algorithm to construct semantically coherent and size‐controllable pseudo‐documents. These pseudo‐documents enrich the document‐level word co‐occurrence context available to LDA, thereby alleviating short‐text sparsity while indirectly incorporating semantic information into the LDA‐based topic modeling process. Dimensionality reduction is further applied to improve the efficiency of clustering high‐dimensional embeddings. Extensive experiments were conducted on a large‐scale Weibo dataset related to Chinese energy enterprises, with additional validation on the public TNEWS benchmark. The results show that the proposed framework generates coherent and interpretable topics while maintaining competitive topic diversity. Ablation studies, FADC analysis, and human‐in‐the‐loop evaluation further support the effectiveness, efficiency, and interpretability of the framework. Applied to energy‐enterprise‐related Weibo posts, the SBERT‐LDA framework identified five distinct hot topics, ranging from corporate finance and stock market trends to new energy technologies, oil and gas markets, and energy infrastructure, providing useful insights for strategic public opinion analysis.

Concurrency and Computation Practice and ExperienceVol. 38(15)
University of Electronic Science and Technology of China (CN), China University of Petroleum, East China (CN), Shandong University of Science and Technology (CN)
Industry, innovation and infrastructure
Openalex Percentile: Top 2%
Computational and Text Analysis Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.