Study on text classification model combining BERT and convolutional neural network

Text classification has been widely used in many practical scenarios such as sentiment analysis and topic classification, and is an important task in the field of natural language processing. In recent years, research on pre-training model based on Bidirectional Encoder Representations from Transformers (BERT) has made remarkable progress. However, at present, most studies are based on open source databases. In this study, a text classification model combining BERT model and convolutional neural network (CNN) is proposed to complete the text emotion classification task through the self-built dialect text database. This paper demonstrates the effectiveness and superiority of this model in Chinese text classification tasks by comparing experiments and performance evaluation.

Authors

Publication Details

Journal
Mathematical Modeling and Algorithm Application
Published
2024-09-12
DOI
https://doi.org/10.54097/7h5bs772
Primary Topic
Text and Document Classification Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Study on text classification model combining BERT and convolutional neural network

Jia Wei, Xiangguo Sun
Mathematical Modeling and Algorithm Application
Text and Document Classification Technologies
article

Study on text classification model combining BERT and convolutional neural network

Jia Wei, Xiangguo Sun
article en

Abstract

Text classification has been widely used in many practical scenarios such as sentiment analysis and topic classification, and is an important task in the field of natural language processing. In recent years, research on pre-training model based on Bidirectional Encoder Representations from Transformers (BERT) has made remarkable progress. However, at present, most studies are based on open source databases. In this study, a text classification model combining BERT model and convolutional neural network (CNN) is proposed to complete the text emotion classification task through the self-built dialect text database. This paper demonstrates the effectiveness and superiority of this model in Chinese text classification tasks by comparing experiments and performance evaluation.

Mathematical Modeling and Algorithm ApplicationVol. 2(3)
Quality Education
Openalex Percentile: Top 87%
Text and Document Classification Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.