TechDoc-RAG: An Evidence-Governed Framework for Software Technical Documentation

Technical support repositories contain large numbers of manuals, technotes, and troubleshooting records, yet their value depends on whether a user can locate and trust the evidence behind an answer.This study develops TechDoc-RAG, an evidence-governed retrieval-augmented generation pipeline for software documentation.Its retrieval layer joins dense semantic search with BM25 lexical search by Reciprocal Rank Fusion (RRF); its response layer separates answerability assessment, corrective retrieval, grounded generation, citation validation, and post-generation support checks.The experiments use NVIDIA TechQA-RAG-Eval and the related TechQA technical-document corpus.On a fixed 100-question retrieval test, Hybrid RRF raised Recall@1 from 0.39 to 0.43, Recall@3 from 0.50 to 0.60, Recall@5 from 0.60 to 0.64, and MRR@5 from 0.4608 to 0.5178 when compared with dense retrieval.The tested cross-encoder reranker added substantial delay without improving the main ranking outcomes.On the separately locked 50-question generation test, the final pipeline increased citation validity from 23.33% to 60% and final refusal accuracy from 0% to 55%, reduced average latency from 1231.26ms to 407.53ms, and eliminated empty outputs.Unsupported outputs decreased from 28 to zero according to the implemented validation criteria.Answer semantic similarity fell from 0.2741 to 0.2356 and the context-support similarity proxy fell from 0.4723 to 0.4111.These findings expose a practical trade-off: stricter evidence controls improve traceability and abstention behavior, but do not improve every automatic semantic measure.

Authors

Institutions

Publication Details

Journal
International Journal of Innovative Research in Technology
Published
2026-09-14
DOI
https://doi.org/10.64643/ijirt.208447-459
Primary Topic
Scientific Computing and Data Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

TechDoc-RAG: An Evidence-Governed Framework for Software Technical Documentation

Sejal Rode, Anuradha Shinde
International Journal of Innovative Research in Technology
Scientific Computing and Data Management
article

TechDoc-RAG: An Evidence-Governed Framework for Software Technical Documentation

Sejal Rode, Anuradha Shinde
article en

Abstract

Technical support repositories contain large numbers of manuals, technotes, and troubleshooting records, yet their value depends on whether a user can locate and trust the evidence behind an answer.This study develops TechDoc-RAG, an evidence-governed retrieval-augmented generation pipeline for software documentation.Its retrieval layer joins dense semantic search with BM25 lexical search by Reciprocal Rank Fusion (RRF); its response layer separates answerability assessment, corrective retrieval, grounded generation, citation validation, and post-generation support checks.The experiments use NVIDIA TechQA-RAG-Eval and the related TechQA technical-document corpus.On a fixed 100-question retrieval test, Hybrid RRF raised Recall@1 from 0.39 to 0.43, Recall@3 from 0.50 to 0.60, Recall@5 from 0.60 to 0.64, and MRR@5 from 0.4608 to 0.5178 when compared with dense retrieval.The tested cross-encoder reranker added substantial delay without improving the main ranking outcomes.On the separately locked 50-question generation test, the final pipeline increased citation validity from 23.33% to 60% and final refusal accuracy from 0% to 55%, reduced average latency from 1231.26ms to 407.53ms, and eliminated empty outputs.Unsupported outputs decreased from 28 to zero according to the implemented validation criteria.Answer semantic similarity fell from 0.2741 to 0.2356 and the context-support similarity proxy fell from 0.4723 to 0.4111.These findings expose a practical trade-off: stricter evidence controls improve traceability and abstention behavior, but do not improve every automatic semantic measure.

International Journal of Innovative Research in TechnologyVol. 13(5)
Indira Gandhi Mirpur University (IN)
Openalex Percentile: Top 4%
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.