Large Language Model Data Augmentation for Text-Pair Classification Tasks

In recent years, large language models (LLMs) have demonstrated remarkable capabilities across various natural language processing tasks.This study explores the application of LLMs for data augmentation in text-pair classification tasks, such as semantic textual similarity and natural language inference.We propose a novel framework that leverages LLMs to generate diverse and contextually relevant paraphrases and transformations of text-pairs, enhancing the training data without manual annotation effort.Our experiments on widely-used benchmarks show that the augmented data not only improves model performance but also increases its robustness to out-of-domain examples.We perform extensive ablation studies to understand the contribution of different augmentation strategies and analyze the trade-offs between data diversity and noise.Additionally, we assess the generalization capabilities of models trained with augmented data across multiple architectures and dataset sizes.The results suggest that LLM-driven data augmentation is a promising approach to overcome data scarcity, reduce overfitting, and enhance the adaptability of text-pair classification systems.

Authors

Institutions

Publication Details

Published
2024-10-25
DOI
https://doi.org/10.1145/3704323.3704362
Citations
1
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Large Language Model Data Augmentation for Text-Pair Classification Tasks

Yuqing Zhang, Ziqi Guo, Zelin Du, Yuyang Li
1 citations
Topic Modeling
0.35
article

Large Language Model Data Augmentation for Text-Pair Classification Tasks

Yuqing Zhang, Ziqi Guo, Zelin Du, Yuyang Li
article en
1 citations

Abstract

In recent years, large language models (LLMs) have demonstrated remarkable capabilities across various natural language processing tasks.This study explores the application of LLMs for data augmentation in text-pair classification tasks, such as semantic textual similarity and natural language inference.We propose a novel framework that leverages LLMs to generate diverse and contextually relevant paraphrases and transformations of text-pairs, enhancing the training data without manual annotation effort.Our experiments on widely-used benchmarks show that the augmented data not only improves model performance but also increases its robustness to out-of-domain examples.We perform extensive ablation studies to understand the contribution of different augmentation strategies and analyze the trade-offs between data diversity and noise.Additionally, we assess the generalization capabilities of models trained with augmented data across multiple architectures and dataset sizes.The results suggest that LLM-driven data augmentation is a promising approach to overcome data scarcity, reduce overfitting, and enhance the adaptability of text-pair classification systems.

China University of Geosciences (Beijing) (CN)
Openalex Percentile: Top 30%
Topic Modeling
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Large Language Model Data Augmentation for Text-Pair Classification Tasks — Yuqing Zhang, Ziqi Guo, et al. · (2024) | TGRS Research Map | TGRS