Analysis of Propaganda in Tweets From Politically Biased Sources

News outlets are well known to have political associations, and many national outlets cultivate political biases to cater to different audiences. Journalists working for these news outlets have a big impact on the stories they cover. In this work, we present a methodology to analyze the role of journalists, affiliated with popular news outlets, in propagating their bias using some form of propaganda-like language. We introduce JMBX(Journalist Media Bias on X), a systematically collected and annotated dataset of 1874 tweets from Twitter (now known as X). These tweets are authored by popular journalists from 10 news outlets whose political biases range from extreme left to extreme right. We extract several insights from the data and conclude that journalists who are affiliated with outlets with extreme biases are more likely to use propaganda-like language in their writings compared to those who are affiliated with outlets with mild political leans. We compare eight different Large Language Models (LLM) by OpenAI and Google. We find that LLMs generally performs better when detecting propaganda in social media and news article compared to BERT-based model which is fine-tuned for propaganda detection. While the performance improvements of using large language models (LLMs) are significant, they come at a notable environmental cost. This study provides an analysis of the environmental impact, utilizing tools that estimate carbon emissions associated with LLM operations.

Authors

Institutions

Publication Details

Journal
Proceedings of the ... International Florida Artificial Intelligence Research Society Conference
Published
2025-05-14
DOI
https://doi.org/10.32473/flairs.38.1.138706
Citations
2
Primary Topic
Social Media and Politics
Type
article
Field-Weighted Citation Impact
13.38
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Analysis of Propaganda in Tweets From Politically Biased Sources

Mohammad Shokri, Sarah Ita Levitan, Vivek Sharma, Elena Filatova et al.
2 citations
Proceedings of the ... International Florida Artificial Intelligence Research Society Conference
Social Media and Politics
13.38
article

Analysis of Propaganda in Tweets From Politically Biased Sources

Mohammad Shokri, Sarah Ita Levitan, Vivek Sharma, Elena Filatova, Shweta Jain
article en
2 citations

Abstract

News outlets are well known to have political associations, and many national outlets cultivate political biases to cater to different audiences. Journalists working for these news outlets have a big impact on the stories they cover. In this work, we present a methodology to analyze the role of journalists, affiliated with popular news outlets, in propagating their bias using some form of propaganda-like language. We introduce JMBX(Journalist Media Bias on X), a systematically collected and annotated dataset of 1874 tweets from Twitter (now known as X). These tweets are authored by popular journalists from 10 news outlets whose political biases range from extreme left to extreme right. We extract several insights from the data and conclude that journalists who are affiliated with outlets with extreme biases are more likely to use propaganda-like language in their writings compared to those who are affiliated with outlets with mild political leans. We compare eight different Large Language Models (LLM) by OpenAI and Google. We find that LLMs generally performs better when detecting propaganda in social media and news article compared to BERT-based model which is fine-tuned for propaganda detection. While the performance improvements of using large language models (LLMs) are significant, they come at a notable environmental cost. This study provides an analysis of the environmental impact, utilizing tools that estimate carbon emissions associated with LLM operations.

Proceedings of the ... International Florida Artificial Intelligence Research Society ConferenceVol. 38
The Graduate Center, CUNY (US), Hunter College (US), New York City College of Technology (US), John Jay College of Criminal Justice (US)
Openalex Percentile: Top 0%
Social Media and Politics
13.38
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.