JST and rJST: joint estimation of sentiment and topics in textual data using a semi-supervised approach

This paper demonstrates the performance of the Joint Sentiment Topic model (JST) and the reversed Joint Sentiment Topic model (rJST) in measuring sentiment in political speeches, comparing them against a set of popular methods for sentiment analysis: widely used off-the-shelf sentiment dictionaries; an embeddings-enhanced dictionary approach; Latent Semantic Scaling, a semi-supervised approach; and a zero-shot transformer-based approach using a large language model (GPT-4). The findings reveal JST’s superiority over all non-transformer-based approaches in predicting human-coded sentiment in multiple languages and its ability to replicate known sentiment trends in legislative speech. rJST, meanwhile, provides valuable topic-specific sentiment estimates, responsive to political dynamics and significant events. Both models are, however, outperformed by transformer-based models like GPT-4. Additionally, the paper introduces the ’sentitopics’ R-package, designed to facilitate the use of JST and rJST in computational text analysis workflows. This package is compatible with popular text analysis tools, making the models accessible for applied researchers in communication science.

Authors

Institutions

Publication Details

Journal
Communication Methods and Measures
Published
2024-10-18
DOI
https://doi.org/10.1080/19312458.2024.2383453
Citations
4
Primary Topic
Computational and Text Analysis Methods
Type
article
Field-Weighted Citation Impact
7.58

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

JST and rJST: joint estimation of sentiment and topics in textual data using a semi-supervised approach

Christian Pipal, Martijn Schoonvelde, Gijs Schumacher, Max Boiten
4 citations
Communication Methods and Measures
Computational and Text Analysis Methods
7.58
article

JST and rJST: joint estimation of sentiment and topics in textual data using a semi-supervised approach

Christian Pipal, Martijn Schoonvelde, Gijs Schumacher, Max Boiten
article en
4 citations

Abstract

This paper demonstrates the performance of the Joint Sentiment Topic model (JST) and the reversed Joint Sentiment Topic model (rJST) in measuring sentiment in political speeches, comparing them against a set of popular methods for sentiment analysis: widely used off-the-shelf sentiment dictionaries; an embeddings-enhanced dictionary approach; Latent Semantic Scaling, a semi-supervised approach; and a zero-shot transformer-based approach using a large language model (GPT-4). The findings reveal JST’s superiority over all non-transformer-based approaches in predicting human-coded sentiment in multiple languages and its ability to replicate known sentiment trends in legislative speech. rJST, meanwhile, provides valuable topic-specific sentiment estimates, responsive to political dynamics and significant events. Both models are, however, outperformed by transformer-based models like GPT-4. Additionally, the paper introduces the ’sentitopics’ R-package, designed to facilitate the use of JST and rJST in computational text analysis workflows. This package is compatible with popular text analysis tools, making the models accessible for applied researchers in communication science.

Communication Methods and MeasuresVol. 19(2)
University of Groningen (NL), Utrecht University (NL), University of Zurich (CH), University of the Arts Utrecht (NL), University of Amsterdam (NL)
European Research Council
Quality Education
Openalex Percentile: Top 2%
Computational and Text Analysis Methods
7.58
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.