Twitter data emotion analysis using Hadoop and metaheuristic optimized Graphical Neural Network
This study applies the Hive framework within the Hadoop ecosystem for sentiment classification, focusing on emotion analysis of X data. After outlining Hadoop's core advantages in large-scale unstructured data processing, the study focuses on using a Graphical Neural Network (GNN) for sentiment categorization of Twitter comments. To address the suboptimal performance of traditional GNNs due to trial-and-error hyperparameter tuning, the study introduces the Modified Elephant Herd Optimization (MEHO) algorithm-improved version of the standard EHO, to optimize the network's weight parameters, hyperparameters, and feature subsets, ensuring a balance between exploration and exploitation. An automated dataset construction system has also been developed to reduce manual labeling effort and ensure consistency. Preprocessing techniques, including information entropy-based phrase ranking, further enhance data quality. To capture both semantic and statistical features of tweets, feature extraction methods such as Term Frequency-Inverse Document Frequency (TF-IDF) and Bag of Words (BoW) are integrated. Experimental results demonstrate that MEHO reduces premature convergence by 40% and improves classification accuracy by 6.1% compared with the standard EHO algorithm. The automated labeling system decreases manual effort by 80%, while entropy-based preprocessing increases phrase difficulty classification accuracy by 7%. This study provides an effective solution for social media emotion analysis; future research will explore multi-modal data fusion and optimize MEHO's convergence speed for ultra-large feature sets.
Authors
- Fangyuan Chen
- Xiaohui Wang (ORCID: https://orcid.org/0000-0001-6388-1229)
- Yang Li (ORCID: https://orcid.org/0000-0002-0403-7287)
Institutions
- Qingdao Huanghai University (CN)
- Shandong University of Science and Technology (CN)
Publication Details
- Journal
- Frontiers in Artificial Intelligence
- Published
- 2025-10-23
- DOI
- https://doi.org/10.3389/frai.2025.1672252
- Primary Topic
- Sentiment Analysis and Opinion Mining
- Type
- article
- Field-Weighted Citation Impact
- 0.00