Exploring large language models for the generation of synthetic training samples for aspect-based sentiment analysis in low resource settings

Aspect-Based Sentiment Analysis (ABSA) is a fine-grained task in sentiment analysis, aiming to identify sentiment expressed towards specific aspects of an entity. This paper explores the use of Large Language Models (LLMs), specifically GPT-3.5-turbo and Llama-3-70B, for generating annotated data in Aspect-Based Sentiment Analysis (ABSA), aiming to address the scarcity of labelled datasets in the field. Two low-resource scenarios are considered, with 25 and 500 manually annotated examples available. In the 25-example scenario, adding synthetic examples generated through few-shot prompting resulted in F1 scores of 81.33 for Aspect Category Detection (ACD) and 71.71 for Aspect Category Sentiment Analysis (ACSA). For the 500-example scenario, synthetic data augmentation showed a notable gain only for the ACSA task, raising the F1 score from 84.54 to 86.70. • LLM-generated examples enhance performance in Aspect Category Detection (ACD). • Synthetic examples lead to an F1 score of 81.33 on the ACD task. • Llama-3-70B generated more linguistically diverse data than GPT-3.

Authors

Institutions

Publication Details

Journal
Expert Systems with Applications
Published
2024-10-17
DOI
https://doi.org/10.1016/j.eswa.2024.125514
Citations
28
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
9.73
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Exploring large language models for the generation of synthetic training samples for aspect-based sentiment analysis in low resource settings

Christian Wolff, Jakob Fehle, Nils Constantin Hellwig
28 citations
Expert Systems with Applications
Sentiment Analysis and Opinion Mining
9.73
article

Exploring large language models for the generation of synthetic training samples for aspect-based sentiment analysis in low resource settings

Christian Wolff, Jakob Fehle, Nils Constantin Hellwig
article en
28 citations

Abstract

Aspect-Based Sentiment Analysis (ABSA) is a fine-grained task in sentiment analysis, aiming to identify sentiment expressed towards specific aspects of an entity. This paper explores the use of Large Language Models (LLMs), specifically GPT-3.5-turbo and Llama-3-70B, for generating annotated data in Aspect-Based Sentiment Analysis (ABSA), aiming to address the scarcity of labelled datasets in the field. Two low-resource scenarios are considered, with 25 and 500 manually annotated examples available. In the 25-example scenario, adding synthetic examples generated through few-shot prompting resulted in F1 scores of 81.33 for Aspect Category Detection (ACD) and 71.71 for Aspect Category Sentiment Analysis (ACSA). For the 500-example scenario, synthetic data augmentation showed a notable gain only for the ACSA task, raising the F1 score from 84.54 to 86.70. • LLM-generated examples enhance performance in Aspect Category Detection (ACD). • Synthetic examples lead to an F1 score of 81.33 on the ACD task. • Llama-3-70B generated more linguistically diverse data than GPT-3.

Expert Systems with ApplicationsVol. 261
OTH Regensburg (DE), University of Regensburg (DE)
Openalex Percentile: Top 2%
Sentiment Analysis and Opinion Mining
9.73
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.