CodeQA: Advanced Programming Question-Answering Using LLM Agent and RAG

In light of this complex information for programming environments, this paper explores how effectiveness in Large Language Models and concepts from Retrieval-Augmented Generation can be used to augment reduced hallucinated question-answering systems for programming environments. The present scenario of transformer-based models, though a big player in natural language processing, doesn't seem to have adaptability and context sensitivity, which is, in fact, a very important feature for a specialist domain. Our study, by integrating a sophisticated LLM model within the RAG framework, further improves the precision, effectiveness of retrieval, and sensitivity of the context of responses. The model based on LLM improves over this transformer-based model by scoring higher in accuracy and context awareness, supported by its pretraining on a massive corpus and dynamic document retrieval functionality. This result underlines the possibility of great improvement in QAS performance, handling very complex and specialized queries, through the integration of LLMs with the RAG systems, and thereby helps in indicating promising areas for further research in optimizing these methodologies across different domains.

Authors

Institutions

Publication Details

Published
2024-10-19
DOI
https://doi.org/10.1109/niles63360.2024.10753267
Citations
6
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
2.08
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CodeQA: Advanced Programming Question-Answering Using LLM Agent and RAG

Ahmed Ashraf, Bassam Mohamed, Mohamed Ahmed, Wael H. Gomaa et al.
6 citations
Natural Language Processing Techniques
2.08
article

CodeQA: Advanced Programming Question-Answering Using LLM Agent and RAG

Ahmed Ashraf, Bassam Mohamed, Mohamed Ahmed, Wael H. Gomaa, Mostafa Dorrah, Yousef Adel, Abdelrahman Elatrozy
article en
6 citations

Abstract

In light of this complex information for programming environments, this paper explores how effectiveness in Large Language Models and concepts from Retrieval-Augmented Generation can be used to augment reduced hallucinated question-answering systems for programming environments. The present scenario of transformer-based models, though a big player in natural language processing, doesn't seem to have adaptability and context sensitivity, which is, in fact, a very important feature for a specialist domain. Our study, by integrating a sophisticated LLM model within the RAG framework, further improves the precision, effectiveness of retrieval, and sensitivity of the context of responses. The model based on LLM improves over this transformer-based model by scoring higher in accuracy and context awareness, supported by its pretraining on a massive corpus and dynamic document retrieval functionality. This result underlines the possibility of great improvement in QAS performance, handling very complex and specialized queries, through the integration of LLMs with the RAG systems, and thereby helps in indicating promising areas for further research in optimizing these methodologies across different domains.

Nile University (EG)
Openalex Percentile: Top 11%
Natural Language Processing Techniques
2.08
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

CodeQA: Advanced Programming Question-Answering Using LLM Agent and RAG — Ahmed Ashraf, Bassam Mohamed, et al. · (2024) | TGRS Research Map | TGRS