A Comparative Analysis of Eight Machine Learning Models for Climate Change Sentiment Analysis

Climate change is the long-term shift in weather patterns from the tropics to the polar regions. This global threat is starting to materialize and is putting pressure on many industries. This study aims to test and compare the performance of eight machine learning models in classifying sentiment related to climate change to find the most accurate and effective model. Thousands of people share their thoughts daily through tweets on the popular microblogging platform Twitter (X). Twitter (X) is a fantastic source for information about public opinion and perceived risks of problems. One of the hot topics being discussed on Twitter is climate change. Climate change is a well-known and rapidly growing topic of study in sentiment analysis in NLP and text classification. This study used LR, SVM, XGB, DT, RF, NB, KNN, and GBM algorithms to examine the issue of climate change. The dataset was obtained from Kaggle and grouped into four sentiment polarities: "News," "Pro," "Neutral," and "Anti," which were then divided into 80% training data and 20% testing data. SMOTE was used to handle imbalanced data in the sentiment polarity classes. With an accuracy of 73.92%, an F1-Score (Macro) of 0.645, and an F1-Score (Weighed) of 0.727, the SVM-Linear algorithm outperformed all algorithms used in the study. In conclusion, the BERT model provides the highest accuracy in classifying climate change-related sentiment compared to the other seven models. This implication provides a scientific basis for selecting the most accurate and efficient machine learning model for detecting public sentiment related to climate change, thus supporting more responsive environmental policymaking.

Authors

Institutions

Publication Details

Journal
JST (Jurnal Sains dan Teknologi)
Published
2025-07-25
DOI
https://doi.org/10.23887/jst-undiksha.v14i2.92672
Primary Topic
Computational and Text Analysis Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Comparative Analysis of Eight Machine Learning Models for Climate Change Sentiment Analysis

Guruh Fajar Shidik, Khusman Anhsori
JST (Jurnal Sains dan Teknologi)
Computational and Text Analysis Methods
article

A Comparative Analysis of Eight Machine Learning Models for Climate Change Sentiment Analysis

Guruh Fajar Shidik, Khusman Anhsori
article en

Abstract

Climate change is the long-term shift in weather patterns from the tropics to the polar regions. This global threat is starting to materialize and is putting pressure on many industries. This study aims to test and compare the performance of eight machine learning models in classifying sentiment related to climate change to find the most accurate and effective model. Thousands of people share their thoughts daily through tweets on the popular microblogging platform Twitter (X). Twitter (X) is a fantastic source for information about public opinion and perceived risks of problems. One of the hot topics being discussed on Twitter is climate change. Climate change is a well-known and rapidly growing topic of study in sentiment analysis in NLP and text classification. This study used LR, SVM, XGB, DT, RF, NB, KNN, and GBM algorithms to examine the issue of climate change. The dataset was obtained from Kaggle and grouped into four sentiment polarities: "News," "Pro," "Neutral," and "Anti," which were then divided into 80% training data and 20% testing data. SMOTE was used to handle imbalanced data in the sentiment polarity classes. With an accuracy of 73.92%, an F1-Score (Macro) of 0.645, and an F1-Score (Weighed) of 0.727, the SVM-Linear algorithm outperformed all algorithms used in the study. In conclusion, the BERT model provides the highest accuracy in classifying climate change-related sentiment compared to the other seven models. This implication provides a scientific basis for selecting the most accurate and efficient machine learning model for detecting public sentiment related to climate change, thus supporting more responsive environmental policymaking.

JST (Jurnal Sains dan Teknologi)Vol. 14(2)
Universitas Dian Nuswantoro (ID)
Openalex Percentile: Top 68%
Computational and Text Analysis Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.