Sentiment Classification on Multivariate Feature Selection on Social Media dataset using Hybrid Machine Learning Techniques

Sentiment classification is a crucial component of natural language processing that focuses on analyzing and classifying the emotional tone conveyed in text data. With the rapid proliferation of social media platforms, the ability to accurately discern public sentiment has become vital for applications spanning marketing, political forecasting, and public opinion analysis. This abstract delves into the implementation of hybrid machine learning techniques for sentiment classification, leveraging multivariate feature selection methods on diverse social media datasets. Traditional machine learning models, though effective, often struggle with the complexity and high dimensionality of social media data, which may include text, emojis, images, and metadata. A hybrid machine learning approach, combining the strengths of various models, addresses these challenges by optimizing both feature selection and classification accuracy. The proposed framework begins with robust data preprocessing, including text normalization and tokenization. Advanced feature extraction methods such as Term Frequency-Inverse Document Frequency (TF-IDF), word embeddings (Word2Vec, GloVe), and sentiment lexicons are utilized to capture the intricate semantic characteristics of the text. For multivariate feature selection, techniques such as Recursive Feature Elimination (RFE), Chi-square tests, and correlation-based feature selection (CFS) are employed to identify and retain the most informative features, thereby improving model efficiency. The classification stage integrates hybrid models, combining the predictive power of algorithms such as Support Vector Machines (SVM), Random Forests, and ensemble learning methods (e.g., gradient boosting). These models are tuned using cross-validation and grid search to enhance generalization performance. The hybrid approach demonstrates superior performance in terms of accuracy, precision, recall, and F1-score compared to standalone machine learning models. The combination of comprehensive feature selection and robust classification algorithms effectively mitigates overfitting and enhances scalability. Empirical results from experiments on real-world social media datasets indicate that the proposed method is adept at capturing nuanced sentiment variations and ensuring high classification accuracy, proving its effectiveness for dynamic and large-scale data analysis.

Authors

Publication Details

Journal
Journal of Information Systems Engineering & Management
Published
2024-12-30
DOI
https://doi.org/10.52783/jisem.v10i1s.234
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Sentiment Classification on Multivariate Feature Selection on Social Media dataset using Hybrid Machine Learning Techniques

Sudeep K. Hase
Journal of Information Systems Engineering & Management
Sentiment Analysis and Opinion Mining
article

Sentiment Classification on Multivariate Feature Selection on Social Media dataset using Hybrid Machine Learning Techniques

Sudeep K. Hase
article en

Abstract

Sentiment classification is a crucial component of natural language processing that focuses on analyzing and classifying the emotional tone conveyed in text data. With the rapid proliferation of social media platforms, the ability to accurately discern public sentiment has become vital for applications spanning marketing, political forecasting, and public opinion analysis. This abstract delves into the implementation of hybrid machine learning techniques for sentiment classification, leveraging multivariate feature selection methods on diverse social media datasets. Traditional machine learning models, though effective, often struggle with the complexity and high dimensionality of social media data, which may include text, emojis, images, and metadata. A hybrid machine learning approach, combining the strengths of various models, addresses these challenges by optimizing both feature selection and classification accuracy. The proposed framework begins with robust data preprocessing, including text normalization and tokenization. Advanced feature extraction methods such as Term Frequency-Inverse Document Frequency (TF-IDF), word embeddings (Word2Vec, GloVe), and sentiment lexicons are utilized to capture the intricate semantic characteristics of the text. For multivariate feature selection, techniques such as Recursive Feature Elimination (RFE), Chi-square tests, and correlation-based feature selection (CFS) are employed to identify and retain the most informative features, thereby improving model efficiency. The classification stage integrates hybrid models, combining the predictive power of algorithms such as Support Vector Machines (SVM), Random Forests, and ensemble learning methods (e.g., gradient boosting). These models are tuned using cross-validation and grid search to enhance generalization performance. The hybrid approach demonstrates superior performance in terms of accuracy, precision, recall, and F1-score compared to standalone machine learning models. The combination of comprehensive feature selection and robust classification algorithms effectively mitigates overfitting and enhances scalability. Empirical results from experiments on real-world social media datasets indicate that the proposed method is adept at capturing nuanced sentiment variations and ensuring high classification accuracy, proving its effectiveness for dynamic and large-scale data analysis.

Journal of Information Systems Engineering & ManagementVol. 10(1s)
Openalex Percentile: Top 76%
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.