Analysis of Propaganda in Tweets From Politically Biased Sources
News outlets are well known to have political associations, and many national outlets cultivate political biases to cater to different audiences. Journalists working for these news outlets have a big impact on the stories they cover. In this work, we present a methodology to analyze the role of journalists, affiliated with popular news outlets, in propagating their bias using some form of propaganda-like language. We introduce JMBX(Journalist Media Bias on X), a systematically collected and annotated dataset of 1874 tweets from Twitter (now known as X). These tweets are authored by popular journalists from 10 news outlets whose political biases range from extreme left to extreme right. We extract several insights from the data and conclude that journalists who are affiliated with outlets with extreme biases are more likely to use propaganda-like language in their writings compared to those who are affiliated with outlets with mild political leans. We compare eight different Large Language Models (LLM) by OpenAI and Google. We find that LLMs generally performs better when detecting propaganda in social media and news article compared to BERT-based model which is fine-tuned for propaganda detection. While the performance improvements of using large language models (LLMs) are significant, they come at a notable environmental cost. This study provides an analysis of the environmental impact, utilizing tools that estimate carbon emissions associated with LLM operations.
Authors
- Mohammad Shokri (ORCID: https://orcid.org/0000-0001-9250-6743)
- Sarah Ita Levitan (ORCID: https://orcid.org/0000-0002-1160-6169)
- Vivek Sharma (ORCID: https://orcid.org/0000-0001-8016-2461)
- Elena Filatova (ORCID: https://orcid.org/0009-0000-2205-6580)
- Shweta Jain (ORCID: https://orcid.org/0009-0009-1792-7199)
Institutions
- The Graduate Center, CUNY (US)
- Hunter College (US)
- New York City College of Technology (US)
- John Jay College of Criminal Justice (US)
Publication Details
- Journal
- Proceedings of the ... International Florida Artificial Intelligence Research Society Conference
- Published
- 2025-05-14
- DOI
- https://doi.org/10.32473/flairs.38.1.138706
- Citations
- 2
- Primary Topic
- Social Media and Politics
- Type
- article
- Field-Weighted Citation Impact
- 13.38