LoRA-Enhanced BERT with Contrastive Learning for Political Sentiment Analysis

This paper presents a strong deep-learning model that aims to improve sentiment classification in political speech. The model combines BERT embeddings, adapted using Low-Rank Adaptation (LoRA), with contrastive learning based on SimCLR and a cross-attention fusion mechanism. This blend enables the model to successfully learn contextual subtleties prevalent in political texts, including sarcasm, ambiguity, and nuanced tone shifts. The model reads data from Reddit posts in the politics category and official parliamentary debates, providing rich, varied textual input. Experimental outcomes of largescale tests show exceptional performance, with $96 \%$ accuracy and a 93% F1 score, surpassing conventional baselines such as vanilla BERT and CLIP-based classifiers. In addition to enhanced accuracy, the architecture is scalable and maintains consistent performance across various policy environments. This method offers policymakers actionable insights into public opinion and debate dynamics by facilitating scalable sentiment analysis suitable for real time settings.

Authors

Institutions

Publication Details

Published
2025-06-20
DOI
https://doi.org/10.1109/conit65521.2025.11166840
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LoRA-Enhanced BERT with Contrastive Learning for Political Sentiment Analysis

Manyam Thaile, Shruti Agarwal, G.Sai Aparna, Medikonda Asha Kiran et al.
Sentiment Analysis and Opinion Mining
article

LoRA-Enhanced BERT with Contrastive Learning for Political Sentiment Analysis

Manyam Thaile, Shruti Agarwal, G.Sai Aparna, Medikonda Asha Kiran, Ramesh Babu Pittala, Muhammad Ahmad Khan
article en

Abstract

This paper presents a strong deep-learning model that aims to improve sentiment classification in political speech. The model combines BERT embeddings, adapted using Low-Rank Adaptation (LoRA), with contrastive learning based on SimCLR and a cross-attention fusion mechanism. This blend enables the model to successfully learn contextual subtleties prevalent in political texts, including sarcasm, ambiguity, and nuanced tone shifts. The model reads data from Reddit posts in the politics category and official parliamentary debates, providing rich, varied textual input. Experimental outcomes of largescale tests show exceptional performance, with $96 \%$ accuracy and a 93% F1 score, surpassing conventional baselines such as vanilla BERT and CLIP-based classifiers. In addition to enhanced accuracy, the architecture is scalable and maintains consistent performance across various policy environments. This method offers policymakers actionable insights into public opinion and debate dynamics by facilitating scalable sentiment analysis suitable for real time settings.

Advanced Numerical Research and Analysis Group (IN)
Openalex Percentile: Top 86%
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.