MDCNN: Multi-Teacher Distillation-Based CNN for News Text Classification

News text classification is crucial for efficient information acquisition and dissemination. While deep learning models, such as BERT and BiGRU, excel in accuracy for text classification, their high complexity and resource demands hinder practical deployment. To address these challenges, we proposed MDCNN (Multi-teacher Distillation-based CNN), which leverages knowledge distillation with BERT and BiGRU as teacher models and TextCNN as the student model. Experiments on three benchmark news dataset demonstrate that MDCNN improves classification accuracy by nearly 2% while significantly reducing computational overhead, offering a practical solution for real-world applications.

Authors

Institutions

Publication Details

Journal
IEEE Access
Published
2025-01-01
DOI
https://doi.org/10.1109/access.2025.3555224
Citations
2
Primary Topic
Handwritten Text Recognition Techniques
Type
article
Field-Weighted Citation Impact
2.55

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

MDCNN: Multi-Teacher Distillation-Based CNN for News Text Classification

Yanrong Hu, Qingyang Liu, Hongjiu Liu, Xiaolei Guo
2 citations
IEEE Access
Handwritten Text Recognition Techniques
2.55
article

MDCNN: Multi-Teacher Distillation-Based CNN for News Text Classification

Yanrong Hu, Qingyang Liu, Hongjiu Liu, Xiaolei Guo
article en
2 citations

Abstract

News text classification is crucial for efficient information acquisition and dissemination. While deep learning models, such as BERT and BiGRU, excel in accuracy for text classification, their high complexity and resource demands hinder practical deployment. To address these challenges, we proposed MDCNN (Multi-teacher Distillation-based CNN), which leverages knowledge distillation with BERT and BiGRU as teacher models and TextCNN as the student model. Experiments on three benchmark news dataset demonstrate that MDCNN improves classification accuracy by nearly 2% while significantly reducing computational overhead, offering a practical solution for real-world applications.

IEEE AccessVol. 13
Zhejiang A & F University (CN), University of Göttingen (DE)
Science Foundation of Ministry of Education of China
Quality Education
Openalex Percentile: Top 11%
Handwritten Text Recognition Techniques
2.55
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.