Sentiment classification optimization based on improved Senti-BERT and BiLSTM-Attention

This study focuses on the problem of insufficient accuracy in sentiment classification in complex texts and multimodal scenarios. A sentiment classification optimization method is proposed, which integrates a bidirectional encoder representation Transformer model for sentiment analysis (Senti-BERT)and a bidirectional Long Short-Term Memory with Attention (BiLSTM-Attention). Firstly, the Senti-BERT layer is introduced to optimize the generation of word vectors by introducing an emotion dictionary leading mechanism, and a dynamic weighting strategy is adopted to fuse multi-modal features such as text, emoticons, and images. Subsequently, the hierarchical attention mechanism of BiLSTM-Attention structure is used to enhance contextual modeling. Finally, the stacking method is adopted to integrate the advantages of multiple models. The experimental results show that this method performs well in multiple dimensions. This optimization method achieved an F1 score of 84.6% in verb sentiment word recognition and 90.1% in adjective recognition, which is 4.8% higher than the bidirectional encoder representation Transformer. The full modal fusion results in a classification accuracy of 89.4%, and the English accuracy exceeds 90% in cross language tasks. The accuracy of emotion segment localization using dynamic weight attention mechanism reaches 90%. The quantization model maintains a low latency of 92ms under 10000QPS concurrency, and the Stacking strategy increases the AUC value to 0.943. The research provides a high-precision solution for social media sentiment analysis through innovative multi-level architecture design.

Authors

Institutions

Publication Details

Journal
PLoS ONE
Published
2026-09-15
DOI
https://doi.org/10.1371/journal.pone.0358103
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Sentiment classification optimization based on improved Senti-BERT and BiLSTM-Attention

Zhaosheng Xu, Jie Zhang, Jianbang Liu
PLoS ONE
Sentiment Analysis and Opinion Mining
article

Sentiment classification optimization based on improved Senti-BERT and BiLSTM-Attention

Zhaosheng Xu, Jie Zhang, Jianbang Liu
article en

Abstract

This study focuses on the problem of insufficient accuracy in sentiment classification in complex texts and multimodal scenarios. A sentiment classification optimization method is proposed, which integrates a bidirectional encoder representation Transformer model for sentiment analysis (Senti-BERT)and a bidirectional Long Short-Term Memory with Attention (BiLSTM-Attention). Firstly, the Senti-BERT layer is introduced to optimize the generation of word vectors by introducing an emotion dictionary leading mechanism, and a dynamic weighting strategy is adopted to fuse multi-modal features such as text, emoticons, and images. Subsequently, the hierarchical attention mechanism of BiLSTM-Attention structure is used to enhance contextual modeling. Finally, the stacking method is adopted to integrate the advantages of multiple models. The experimental results show that this method performs well in multiple dimensions. This optimization method achieved an F1 score of 84.6% in verb sentiment word recognition and 90.1% in adjective recognition, which is 4.8% higher than the bidirectional encoder representation Transformer. The full modal fusion results in a classification accuracy of 89.4%, and the English accuracy exceeds 90% in cross language tasks. The accuracy of emotion segment localization using dynamic weight attention mechanism reaches 90%. The quantization model maintains a low latency of 92ms under 10000QPS concurrency, and the Stacking strategy increases the AUC value to 0.943. The research provides a high-precision solution for social media sentiment analysis through innovative multi-level architecture design.

PLoS ONEVol. 21(9)
Xinyu University (CN), Universiti Teknologi MARA (MY)
Quality Education
Openalex Percentile: Top 8%
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Sentiment classification optimization based on improved Senti-BERT and BiLSTM-Attention — Zhaosheng Xu, Jie Zhang, et al. · PLoS ONE (2026) | TGRS Research Map | TGRS