A comprehensive framework for legal dispute analysis integrating prompt engineering and multi-dimensional knowledge graphs
Legal dispute analysis is crucial for intelligent legal assistance systems. However, current Large Language Models (LLMs) face challenges in understanding complex legal concepts, maintaining reasoning consistency, and accurately citing legal sources. This study presents a framework combining prompt engineering with multi-dimensional knowledge graphs to improve LLM capabilities for legal dispute analysis. The framework comprises a three-stage hierarchical prompt structure (task definition, knowledge background, reasoning guidance) and a three-layer knowledge graph (legal classification ontology layer, representation layer, instance layer). Additionally, four supporting methods enable legal concept retrieval: direct code matching, semantic vector similarity, ontology path reasoning, and professional terminology matching. Systematic testing on 500 test samples integrated from six internationally recognized legal AI benchmark datasets demonstrates performance improvements for mainstream models: F1 score increased from 0.356 to 0.714, BLEU-4 reached 0.451, ROUGE-L F1 improved from 0.34 to 0.71, and legal professional content quality scores increased by 18-20 points (on a 100-point scale). This framework provides a technical approach for legal analysis, contributing to the advancement of intelligent legal assistance systems.
Authors
- Ting Luo (ORCID: https://orcid.org/0000-0003-1793-729X)
- Na Zhao (ORCID: https://orcid.org/0000-0002-6166-2118)
- Qing Xu (ORCID: https://orcid.org/0000-0003-2505-7188)
- Kaiwen Pan (ORCID: https://orcid.org/0000-0003-1770-8219)
- Jianwu Qin (ORCID: https://orcid.org/0000-0002-4981-4510)
- Mingda Zhang
Institutions
- Yunnan University (CN)
Publication Details
- Journal
- Scientific Reports
- Published
- 2025-12-18
- DOI
- https://doi.org/10.1038/s41598-025-30306-9
- Primary Topic
- Artificial Intelligence in Law
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Yunnan Provincial Department of Education