RAG-Based Legal Document Question Answering using Large Language Models.

The recent rapid development of LLMs (Large Language Models) has brought new opportunities to the intelligent analysis and question answering about legal documents. At the same time, the use of conventional LLMs could result in inaccurate answers because of the lack of knowledge completeness, freshness, and relevance to official sources. The issue of inadequate answers provided by LLMs can be solved with the help of RAG (Retrieval-Augmented Generation), which is capable of retrieving relevant documents from an external collection and passing this data as context information to the LLM during the answer generation process. This paper proposes the RAG framework for question answering about legal documents, including legal documents preprocessing, structure-aware text chunking, semantic retrieval, and answer generation with the use of LLM. The proposed approach is designed for retrieving relevant legal provisions, clauses, and cases passages and generating answers based on this evidence. The paper studies the framework through the lens of the following metrics: retrieval accuracy, answer relevance, factual faithfulness, citation correctness, and hallucination rate. The comparative analysis with conventional vector-based RAG and LLM-based question answering will be performed to test the effectiveness of the proposed framework.

Authors

Institutions

Publication Details

Journal
Iconic Research and Engineering Journals
Published
2026-11-18
DOI
https://doi.org/10.64388/ire1725280
Primary Topic
Artificial Intelligence in Law
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

RAG-Based Legal Document Question Answering using Large Language Models.

Yash Jaiswal, Paras Bansal, Gautam Kumar, Manveer Singh
1 links
Iconic Research and Engineering Journals
Artificial Intelligence in Law
article

RAG-Based Legal Document Question Answering using Large Language Models.

Yash Jaiswal, Paras Bansal, Gautam Kumar, Manveer Singh
article en

Abstract

The recent rapid development of LLMs (Large Language Models) has brought new opportunities to the intelligent analysis and question answering about legal documents. At the same time, the use of conventional LLMs could result in inaccurate answers because of the lack of knowledge completeness, freshness, and relevance to official sources. The issue of inadequate answers provided by LLMs can be solved with the help of RAG (Retrieval-Augmented Generation), which is capable of retrieving relevant documents from an external collection and passing this data as context information to the LLM during the answer generation process. This paper proposes the RAG framework for question answering about legal documents, including legal documents preprocessing, structure-aware text chunking, semantic retrieval, and answer generation with the use of LLM. The proposed approach is designed for retrieving relevant legal provisions, clauses, and cases passages and generating answers based on this evidence. The paper studies the framework through the lens of the following metrics: retrieval accuracy, answer relevance, factual faithfulness, citation correctness, and hallucination rate. The comparative analysis with conventional vector-based RAG and LLM-based question answering will be performed to test the effectiveness of the proposed framework.

Iconic Research and Engineering JournalsVol. 10(5)
Chandigarh University (IN)
Peace, justice, and strong institutions
Artificial Intelligence in Law
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon