Multi-Head Hierarchical Attention Framework with Multi-Level Learning Optimization Strategy for Legal Text Recognition
Owing to the rapid increase in the amount of legal text data and the increasing demand for intelligent processing, multi-label legal text recognition is becoming increasingly important in practical applications such as legal information retrieval and case classification. However, traditional methods have limitations in handling the complex semantics and multi-label characteristics of legal texts, making it difficult to accurately extract feature and effective category information. Therefore, this study proposes a novel multi-head hierarchical attention framework suitable for multi-label legal text recognition tasks. This framework comprises a feature extraction module and a hierarchical module. The former extracts multi-level semantic representations of text, while the latter obtains multi-label category information. In addition, this study proposes a novel hierarchical learning optimization strategy that balances the learning needs of multi-level semantic representation and multi-label category information through data preprocessing, loss calculation, and weight updating, effectively accelerating the convergence speed of framework training. We conducted comparative experiments on the legal domain dataset CAIL2021 and the general multi-label recognition datasets AAPD and Web of Science (WOS). The results indicate that the method proposed in this study is significantly superior to mainstream methods in legal and general scenarios, demonstrating excellent performance. The study findings are expected to be widely applied in the field of intelligent processing of legal information, improving the accuracy of intelligent classification of judicial cases and further promoting the digitalization and intelligence process of the legal industry.
Authors
- Zhongliang Ai
- Zhonglin Liu (ORCID: https://orcid.org/0000-0002-3239-5647)
- Jun Lu (ORCID: https://orcid.org/0000-0002-7907-1543)
- Xuelin Liu (ORCID: https://orcid.org/0009-0003-4008-6689)
- Licai Wang (ORCID: https://orcid.org/0009-0008-1163-2106)
- Yu-Hao Tu (ORCID: https://orcid.org/0000-0002-3632-5339)
- Ke Zhang (ORCID: https://orcid.org/0000-0002-1611-6804)
Institutions
- Beijing University of Posts and Telecommunications (CN)
- Institute of Computing Technology (CN)
- Beijing Institute of Big Data Research (CN)
- China Academy of Information and Communications Technology (CN)
Publication Details
- Journal
- Electronics
- Published
- 2025-05-10
- DOI
- https://doi.org/10.3390/electronics14101946
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- National Key Research and Development Program of China