Long Text Classification Model Based on Transformer Sliding Window and Threshold Optimization

In long-text classification tasks, the main issue we face is that traditional text classification methods lack the capability to analyze complex contextual information and implicit semantics, resulting in poor classification performance. To address the shortcomings of existing long-text classification models—such as poor accuracy, low efficiency, inadequate dynamic adjustment, and poor threshold adaptability—we propose a Transformer-based sliding window threshold optimization long-text classification model. We investigate an automatic classification and dynamic partitioning method for long-text semantic analysis. The approach utilizes context-aware fusion of semantic information from long texts to improve the accuracy of automated long-text classification. Finally, we employ an error feedback mechanism to dynamically adjust the classification threshold, achieving optimized threshold settings for long-text content classification. The experiment shows that this model surpasses the baseline model in accuracy and F1 performance on the dataset and exhibits good convergence speed, validating its effectiveness.

Authors

Publication Details

Journal
網際網路技術學刊
Published
2025-03-26
DOI
https://doi.org/10.70003/160792642025032602008
Primary Topic
Advanced Computational Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Long Text Classification Model Based on Transformer Sliding Window and Threshold Optimization

Jie Chu, Chunlu Zhao, Yang Chen, Jin Pan et al.
網際網路技術學刊
Advanced Computational Techniques and Applications
article

Long Text Classification Model Based on Transformer Sliding Window and Threshold Optimization

Jie Chu, Chunlu Zhao, Yang Chen, Jin Pan, Yang Liu
article en

Abstract

In long-text classification tasks, the main issue we face is that traditional text classification methods lack the capability to analyze complex contextual information and implicit semantics, resulting in poor classification performance. To address the shortcomings of existing long-text classification models—such as poor accuracy, low efficiency, inadequate dynamic adjustment, and poor threshold adaptability—we propose a Transformer-based sliding window threshold optimization long-text classification model. We investigate an automatic classification and dynamic partitioning method for long-text semantic analysis. The approach utilizes context-aware fusion of semantic information from long texts to improve the accuracy of automated long-text classification. Finally, we employ an error feedback mechanism to dynamically adjust the classification threshold, achieving optimized threshold settings for long-text content classification. The experiment shows that this model surpasses the baseline model in accuracy and F1 performance on the dataset and exhibits good convergence speed, validating its effectiveness.

網際網路技術學刊Vol. 26(2)
Openalex Percentile: Top 98%
Advanced Computational Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.