RAGOps: Environment-Conditioned Retrieval for Operational Knowledge

Enterprise operations teams confront a structural failure mode in incident response: the same error signature carries different root causes in different environments, yet the knowledge required to disambiguate them is scattered across systems optimized for tracking rather than retrieval. This paper introduces RAGOps, an architecture that formalizes operational knowledge retrieval as a metadata-constrained, typed, non-stationary ranking problem: an environment predicate is applied before similarity, the corpus is a typed union of five knowledge forms (runbooks, incident cases, curated terminal runs, validated operational rules, and deduplicated error signatures), and ranking evolves with feedback without model retraining. The architecture combines curation-first ingestion with a secrets-rejecting gate ahead of embedding, fully local inference, single-round-trip multi-corpus first-stage retrieval, and agent integration via the Model Context Protocol under a read-auto/write-approved permission asymmetry, in two interoperable deployment profiles (PostgreSQL/pgvector server; sqlite-vec embedded). On an open, deterministic synthetic benchmark (342 items, 160 graded queries), the environment predicate is the dominant quality lever regardless of retrieval method - raising Recall@10 from 0.36 to 0.85 for BM25 and 0.19 to 0.82 for dense retrieval while eliminating wrong-environment results that otherwise contaminate 66% of top-5 slots. Filtered BM25 is the strongest single configuration on lexically-anchored operational text (MRR@10 0.93), and a MiniLM-family cross-encoder fails to exploit superior lexical candidates when given them - evidence that measured domain-token embedding drift propagates to rerankers. Deployment feasibility is reported from two anonymized enterprise contexts. The benchmark, runner, and results are released for exact reproduction at https://github.com/sunilrreddy/ragops-bench. An extended technical report is included as a supplementary file.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-07-18
DOI
https://doi.org/10.5281/zenodo.21425701
Primary Topic
Data Quality and Management
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

RAGOps: Environment-Conditioned Retrieval for Operational Knowledge

Rekha Kota -, Sunil Kumar Revuri
Zenodo (CERN European Organization for Nuclear Research)
Data Quality and Management
preprint

RAGOps: Environment-Conditioned Retrieval for Operational Knowledge

Rekha Kota -, Sunil Kumar Revuri
preprint en

Abstract

Enterprise operations teams confront a structural failure mode in incident response: the same error signature carries different root causes in different environments, yet the knowledge required to disambiguate them is scattered across systems optimized for tracking rather than retrieval. This paper introduces RAGOps, an architecture that formalizes operational knowledge retrieval as a metadata-constrained, typed, non-stationary ranking problem: an environment predicate is applied before similarity, the corpus is a typed union of five knowledge forms (runbooks, incident cases, curated terminal runs, validated operational rules, and deduplicated error signatures), and ranking evolves with feedback without model retraining. The architecture combines curation-first ingestion with a secrets-rejecting gate ahead of embedding, fully local inference, single-round-trip multi-corpus first-stage retrieval, and agent integration via the Model Context Protocol under a read-auto/write-approved permission asymmetry, in two interoperable deployment profiles (PostgreSQL/pgvector server; sqlite-vec embedded). On an open, deterministic synthetic benchmark (342 items, 160 graded queries), the environment predicate is the dominant quality lever regardless of retrieval method - raising Recall@10 from 0.36 to 0.85 for BM25 and 0.19 to 0.82 for dense retrieval while eliminating wrong-environment results that otherwise contaminate 66% of top-5 slots. Filtered BM25 is the strongest single configuration on lexically-anchored operational text (MRR@10 0.93), and a MiniLM-family cross-encoder fails to exploit superior lexical candidates when given them - evidence that measured domain-token embedding drift propagates to rerankers. Deployment feasibility is reported from two anonymized enterprise contexts. The benchmark, runner, and results are released for exact reproduction at https://github.com/sunilrreddy/ragops-bench. An extended technical report is included as a supplementary file.

Zenodo (CERN European Organization for Nuclear Research)
Oracle (United States) (US), Capgemini (Netherlands) (NL)
Data Quality and Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

RAGOps: Environment-Conditioned Retrieval for Operational Knowledge — Rekha Kota -, Sunil Kumar Revuri · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS