Tools, Not Code: Microservice Root Cause Analysis with Cost-Effective Language Models

Automated root cause analysis (RCA) in microservice systems has recently been framed as a code-generation task, where an LLM agent writes and executes analysis scripts over telemetry data. While effective with frontier models, this approach degrades substantially with non-frontier models, whose weaker coding abilities often cause execution failures. We present a tool-augmented multi-agent RCA system that replaces ad-hoc code generation with 11 structured diagnostic tools for anomaly detection, causal analysis, and multi-signal integration. The system uses a four-stage pipeline combining deterministic triage, LLM-based hypothesis formation, targeted hypothesis testing, and ensemble prediction. On the OpenRCA benchmark (335 failure scenarios across four microservice systems), our system with gpt-5-mini improves binary accuracy from 7.5% to 12.8% and partial score from 15.9% to 37.9% over the code-generation paradigm. A component contribution analysis reveals that deterministic triage—compiling domain knowledge into algorithmic preprocessing—accounts for the largest accuracy gain, while multi-agent investigation improves fault-type discrimination at the cost of occasional over-falsification, identifying a concrete improvement target. These results suggest that the most effective architectural decomposition for cost-effective RCA is deterministic evidence reduction first, with LLM reasoning applied to the residual ambiguity.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-07-23
DOI
https://doi.org/10.5281/zenodo.21503088
Primary Topic
Software System Performance and Reliability
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Tools, Not Code: Microservice Root Cause Analysis with Cost-Effective Language Models

Jaewan Choi, Sungwon Lee, Hanjae Kim, Youngdong Kim et al.
Zenodo (CERN European Organization for Nuclear Research)
Software System Performance and Reliability
article

Tools, Not Code: Microservice Root Cause Analysis with Cost-Effective Language Models

Jaewan Choi, Sungwon Lee, Hanjae Kim, Youngdong Kim, Sungjoon Bang, Kihoon Shin
article en

Abstract

Automated root cause analysis (RCA) in microservice systems has recently been framed as a code-generation task, where an LLM agent writes and executes analysis scripts over telemetry data. While effective with frontier models, this approach degrades substantially with non-frontier models, whose weaker coding abilities often cause execution failures. We present a tool-augmented multi-agent RCA system that replaces ad-hoc code generation with 11 structured diagnostic tools for anomaly detection, causal analysis, and multi-signal integration. The system uses a four-stage pipeline combining deterministic triage, LLM-based hypothesis formation, targeted hypothesis testing, and ensemble prediction. On the OpenRCA benchmark (335 failure scenarios across four microservice systems), our system with gpt-5-mini improves binary accuracy from 7.5% to 12.8% and partial score from 15.9% to 37.9% over the code-generation paradigm. A component contribution analysis reveals that deterministic triage—compiling domain knowledge into algorithmic preprocessing—accounts for the largest accuracy gain, while multi-agent investigation improves fault-type discrimination at the cost of occasional over-falsification, identifying a concrete improvement target. These results suggest that the most effective architectural decomposition for cost-effective RCA is deterministic evidence reduction first, with LLM reasoning applied to the residual ambiguity.

Zenodo (CERN European Organization for Nuclear Research)
Nokia (Finland) (FI)
Reduced inequalities, Peace, Justice and strong institutions
Openalex Percentile: Top 6%
Software System Performance and Reliability
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.