The Feasibility of Using Synthetic-Generated Dataset for Training Sentiment Analysis Model

New features in machine learning applications are constantly being explored demanding the availability and quality of data. To address this, the exploration of synthetic data emerges as a promising solution. This paper intends to solve the problem of data availability by finding out the feasibility of using synthetic data as a solution. Many researchers tried to use algorithms such as SMOTE and ADASYN, but encountered challenges in producing semantically and grammatically acceptable material. One of the few front-runners in synthetic text data generation is GPT 3.5. A trained sentiment analysis model would benefit users greatly by providing valuable insights into given text data, helping to understand emotions, opinions, and trends. The criteria of a high-quality dataset is providing various examples for each class. High-quality training data is crucial for accurate sentiment analysis, ensuring correct patterns, bias minimization, and reliable predictions. This paper utilizes GPT 3.5 to generate the synthetic data, with BERT and CNN-LSTM as the model architectures. Each architecture employs three models, each with a unique train-test combination that serves its own purpose. The performance of the six trained models is compared based on accuracy, precision, recall, and F1 score to evaluate the quality and efficacy of synthetic data. The conducted evaluation shows that data augmentation using synthetic data is feasible. This finding is presented as the main contribution of the study. However, fully synthetic data-trained models require more refining.

Authors

Institutions

Publication Details

Published
2024-11-07
DOI
https://doi.org/10.1109/icitda64560.2024.10810031
Citations
1
Primary Topic
AI and HR Technologies
Type
article
Field-Weighted Citation Impact
0.67
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Feasibility of Using Synthetic-Generated Dataset for Training Sentiment Analysis Model

Rhio Sutoyo, Nicole Wijaya, Denovan Widjaja, Bianca Chelsea Putri Nugroho
1 citations
AI and HR Technologies
0.67
article

The Feasibility of Using Synthetic-Generated Dataset for Training Sentiment Analysis Model

Rhio Sutoyo, Nicole Wijaya, Denovan Widjaja, Bianca Chelsea Putri Nugroho
article en
1 citations

Abstract

New features in machine learning applications are constantly being explored demanding the availability and quality of data. To address this, the exploration of synthetic data emerges as a promising solution. This paper intends to solve the problem of data availability by finding out the feasibility of using synthetic data as a solution. Many researchers tried to use algorithms such as SMOTE and ADASYN, but encountered challenges in producing semantically and grammatically acceptable material. One of the few front-runners in synthetic text data generation is GPT 3.5. A trained sentiment analysis model would benefit users greatly by providing valuable insights into given text data, helping to understand emotions, opinions, and trends. The criteria of a high-quality dataset is providing various examples for each class. High-quality training data is crucial for accurate sentiment analysis, ensuring correct patterns, bias minimization, and reliable predictions. This paper utilizes GPT 3.5 to generate the synthetic data, with BERT and CNN-LSTM as the model architectures. Each architecture employs three models, each with a unique train-test combination that serves its own purpose. The performance of the six trained models is compared based on accuracy, precision, recall, and F1 score to evaluate the quality and efficacy of synthetic data. The conducted evaluation shows that data augmentation using synthetic data is feasible. This finding is presented as the main contribution of the study. However, fully synthetic data-trained models require more refining.

Binus University (ID)
Openalex Percentile: Top 20%
AI and HR Technologies
0.67
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.