Data augmentation methods for classifying Korean texts

Data augmentation is widely adopted in computer vision.In contrast, research on data augmentation in the field of natural language processing has been limited.We propose several data augmentation methods to support the classification of Korean texts.We increase the size and diversity of text data which are specifically tailored to Korean.These methods adopt and adjust the existing data augmentation for English texts.We could improve the classification accuracy and sometimes regularize the natural language models to reduce the overfits.Our contribution to the data augmentation regarding Korean texts compose of three parts.1) data augmentation with Spelling Correction, 2) Easy data augmentation based on part-of-speech tagging, and 3) Data augmentation with conditional Masked Language Modeling.Our experiments show that classification accuracy can be improved with the aids of our proposed methods.Due to the limit of computing facilities, we consider rather small-scale Korean texts only.

Authors

Institutions

Publication Details

Journal
Korean Journal of Applied Statistics
Published
2024-10-28
DOI
https://doi.org/10.5351/kjas.2024.37.5.599
Primary Topic
Text and Document Classification Technologies
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Data augmentation methods for classifying Korean texts

Yoonsuh Jung, Jihyun Jeon
Korean Journal of Applied Statistics
Text and Document Classification Technologies
article

Data augmentation methods for classifying Korean texts

Yoonsuh Jung, Jihyun Jeon
article en

Abstract

Data augmentation is widely adopted in computer vision.In contrast, research on data augmentation in the field of natural language processing has been limited.We propose several data augmentation methods to support the classification of Korean texts.We increase the size and diversity of text data which are specifically tailored to Korean.These methods adopt and adjust the existing data augmentation for English texts.We could improve the classification accuracy and sometimes regularize the natural language models to reduce the overfits.Our contribution to the data augmentation regarding Korean texts compose of three parts.1) data augmentation with Spelling Correction, 2) Easy data augmentation based on part-of-speech tagging, and 3) Data augmentation with conditional Masked Language Modeling.Our experiments show that classification accuracy can be improved with the aids of our proposed methods.Due to the limit of computing facilities, we consider rather small-scale Korean texts only.

Korean Journal of Applied StatisticsVol. 37(5)
Statistics Korea (KR), Korea University (KR)
National Research Foundation, Korea University, National Research Foundation of Korea
Openalex Percentile: Top 83%
Text and Document Classification Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Data augmentation methods for classifying Korean texts — Yoonsuh Jung, Jihyun Jeon · Korean Journal of Applied Statistics (2024) | TGRS Research Map | TGRS