A Text Augmentation Method Based on Dual Diversity Generation

In text augmentation in the field of natural language processing, it has been observed that most of the traditional methods often result in only minimal changes to the original text, which consequently limits the diversity of the augmented samples. In this paper, a novel text augmentation method based on Dual Diversity Generation is proposed, which effectively addresses the aforementioned limitation through two key components: keyword diversity and sample diversity. Initially, a sketch is constructed through keyphrase extraction, which is subsequently input into the text augmentation model for the generation of new samples. To mitigate the semantic overlap among the extracted keyphrases, keyphrase diversity is incorporated into the extraction process. Furthermore, sample diversity is emphasized during the generation phase to enhance the overall quality of the text augmentation. The performance of the proposed method is evaluated by text classification effect, and the experimental results indicate that the proposed method achieves significant improvements compared to other methods.

Authors

Institutions

Publication Details

Published
2024-12-06
DOI
https://doi.org/10.1109/ricai64321.2024.10911762
Primary Topic
Text and Document Classification Technologies
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Text Augmentation Method Based on Dual Diversity Generation

Xinyue Guo, Qingwu Fan
Text and Document Classification Technologies
article

A Text Augmentation Method Based on Dual Diversity Generation

Xinyue Guo, Qingwu Fan
article en

Abstract

In text augmentation in the field of natural language processing, it has been observed that most of the traditional methods often result in only minimal changes to the original text, which consequently limits the diversity of the augmented samples. In this paper, a novel text augmentation method based on Dual Diversity Generation is proposed, which effectively addresses the aforementioned limitation through two key components: keyword diversity and sample diversity. Initially, a sketch is constructed through keyphrase extraction, which is subsequently input into the text augmentation model for the generation of new samples. To mitigate the semantic overlap among the extracted keyphrases, keyphrase diversity is incorporated into the extraction process. Furthermore, sample diversity is emphasized during the generation phase to enhance the overall quality of the text augmentation. The performance of the proposed method is evaluated by text classification effect, and the experimental results indicate that the proposed method achieves significant improvements compared to other methods.

Beijing University of Technology (CN)
Research and Development
Quality Education
Openalex Percentile: Top 74%
Text and Document Classification Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.