Enhancing Question-Answering with Knowledge Graph Retrieval and Generation using LLMs

This paper describes a novel technique to improving Large Language Models (LLMs) for document analysis that employs knowledge graphs and retrieval-augmented generation (RAG). We are working on constructing a chatbot system that can handle and analyze large documents from a variety of fields. Our approach addresses basic LLM issues including context maintenance and hallucination avoidance. The system combines document chunking, vector embedding, and similarity search with graph-based knowledge representation. Users can upload large papers and answer questions accurately. We show that integrating standard information retrieval approaches with graph-based storage and LLM capabilities improves context awareness and response accuracy across a wide range of document genres. This strategy is especially promising for complicated publications such as financial reports.