A Dynamic Retrieval-Augmented Generation Framework for Border Inspection Legal Question Answering
Border inspection legal question answering (LQA) is designed for specific legal scenarios, aiming to address legal questions related to border inspections and provide accurate and practical legal guidance to the public and border inspection departments. Current research requires a retrieval process regardless of whether the necessary knowledge already exists, and does not evaluate the legal information in the generated responses, leading to errors and low-quality content. we propose the Dynamic Retrieval-Augmented Generation framework for Border Inspection LQA (DRAG-BILQA), which generates responses first and then dynamically controls retrieval based on confidence scores. In this framework, we innovatively introduce a legal factor recognition module to ensure the legal accuracy of generated answers and improve the quality of the generation. We also present the BorderLegal-QA dataset, filling the gap in border inspection legal datasets. We conducted extensive experiments on both the BorderLegal-QA and the general LQA dataset JEC-QA. Experimental results show that DRAG-BILQA outperforms Sota models in terms of legal factor recognition accuracy and retrieval performance, achieving a METEOR score of 39.5 and improving generation quality. Case analysis also demonstrate that DRAG-BILQA effectively Augmented the legal accuracy of the generated content.
Authors
- Dapeng Li (ORCID: https://orcid.org/0000-0002-6105-8885)
- Yanjun Zhang (ORCID: https://orcid.org/0000-0002-9702-1128)
- Shuang Guo (ORCID: https://orcid.org/0009-0009-2779-6444)
- Gaojun Peng
- Yu Dou
- Ruheng Yi
Institutions
- Mongolian University of Science and Technology (MN)
Publication Details
- Published
- 2024-08-04
- DOI
- https://doi.org/10.1109/ialp63756.2024.10661194
- Citations
- 1
- Primary Topic
- Artificial Intelligence in Law
- Type
- article
- Field-Weighted Citation Impact
- 2.23
Funders
- Natural Science Foundation of Inner Mongolia