An <scp>SBERT</scp> ‐ <scp>LDA</scp> Framework With <scp>FADC</scp> ‐Based Semantic Aggregation for Short‐Text Topic Modeling of Online Public Opinion on Energy Enterprises
ABSTRACT With the rapid growth of digital social media, identifying hot topics in online public opinion has become important for public opinion monitoring and risk management in the energy sector. Latent Dirichlet allocation (LDA) has been widely used for topic discovery on social media platforms such as Weibo. However, traditional LDA‐based methods often face challenges when applied to short texts because individual posts contain limited word co‐occurrence information. In addition, the bag‐of‐words representation used by LDA limits its ability to capture contextual semantic relationships. To address these problems, this study proposes an SBERT‐LDA framework for short‐text topic modeling of online public opinion related to energy enterprises. The framework uses sentence‐BERT (SBERT) to capture sentence‐level semantic similarity and introduces a fast adaptive density clustering (FADC) algorithm to construct semantically coherent and size‐controllable pseudo‐documents. These pseudo‐documents enrich the document‐level word co‐occurrence context available to LDA, thereby alleviating short‐text sparsity while indirectly incorporating semantic information into the LDA‐based topic modeling process. Dimensionality reduction is further applied to improve the efficiency of clustering high‐dimensional embeddings. Extensive experiments were conducted on a large‐scale Weibo dataset related to Chinese energy enterprises, with additional validation on the public TNEWS benchmark. The results show that the proposed framework generates coherent and interpretable topics while maintaining competitive topic diversity. Ablation studies, FADC analysis, and human‐in‐the‐loop evaluation further support the effectiveness, efficiency, and interpretability of the framework. Applied to energy‐enterprise‐related Weibo posts, the SBERT‐LDA framework identified five distinct hot topics, ranging from corporate finance and stock market trends to new energy technologies, oil and gas markets, and energy infrastructure, providing useful insights for strategic public opinion analysis.
Authors
- Chun Liu (ORCID: https://orcid.org/0000-0002-8981-534X)
- C W Wang
- Yi-Xiang Wang (ORCID: https://orcid.org/0000-0002-5246-5497)
- Yibo Zhao
- Jiaen Shangguan
Institutions
- University of Electronic Science and Technology of China (CN)
- China University of Petroleum, East China (CN)
- Shandong University of Science and Technology (CN)
Publication Details
- Journal
- Concurrency and Computation Practice and Experience
- Published
- 2026-07-22
- DOI
- https://doi.org/10.1002/cpe.70874
- Primary Topic
- Computational and Text Analysis Methods
- Type
- article
- Field-Weighted Citation Impact
- 0.00