Public Opinion Analysis Using Sentiment Analysis: A Comparative Benchmark of Lexicon, Machine Learning, and Transformer Architectures

Understanding public sentiment across political, civic, and consumer domains is pivotal for governance, policy formulation, and commercial strategy. Traditional public polling methodologies suffer from sampling bias, high expenditure, and non-trivial temporal latency. Microblogging and digital forums provide a continuous stream of public discourse, yet extracting structured sentiment from unorganized text poses substantial computational challenges. This paper implements a systematic 6-step analytical framework to evaluate sentiment extraction models on diverse public opinion datasets (POD-Pol24, POD-Civic, and POD-Cons). We compare four computational paradigms: lexicon-based inference (VADER), classical statistical machine learning (Linear SVM with TF-IDF), recurrent neural networks (Bi-LSTM with contextual embeddings), and fine-tuned self-attention Transformers (RoBERTa-base). Experimental metrics demonstrate that while lexicon methods yield rapid baseline inference (F1 = 0.681), fine-tuned Transformer models achieve superior contextual accuracy (F1 = 0.923), effectively resolving polysemy and complex sentence structures. We further examine domain-specific constraints including sarcasm, code-switching, and computational scalability.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-16
DOI
https://doi.org/10.5281/zenodo.24283093
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Public Opinion Analysis Using Sentiment Analysis: A Comparative Benchmark of Lexicon, Machine Learning, and Transformer Architectures

Subiksha Raveendranath Srirangam
4 links
Zenodo (CERN European Organization for Nuclear Research)
Sentiment Analysis and Opinion Mining
article

Public Opinion Analysis Using Sentiment Analysis: A Comparative Benchmark of Lexicon, Machine Learning, and Transformer Architectures

Subiksha Raveendranath Srirangam
article en

Abstract

Understanding public sentiment across political, civic, and consumer domains is pivotal for governance, policy formulation, and commercial strategy. Traditional public polling methodologies suffer from sampling bias, high expenditure, and non-trivial temporal latency. Microblogging and digital forums provide a continuous stream of public discourse, yet extracting structured sentiment from unorganized text poses substantial computational challenges. This paper implements a systematic 6-step analytical framework to evaluate sentiment extraction models on diverse public opinion datasets (POD-Pol24, POD-Civic, and POD-Cons). We compare four computational paradigms: lexicon-based inference (VADER), classical statistical machine learning (Linear SVM with TF-IDF), recurrent neural networks (Bi-LSTM with contextual embeddings), and fine-tuned self-attention Transformers (RoBERTa-base). Experimental metrics demonstrate that while lexicon methods yield rapid baseline inference (F1 = 0.681), fine-tuned Transformer models achieve superior contextual accuracy (F1 = 0.923), effectively resolving polysemy and complex sentence structures. We further examine domain-specific constraints including sarcasm, code-switching, and computational scalability.

Zenodo (CERN European Organization for Nuclear Research)
Srinivas University (IN)
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon