1369-UC LLM-Based Evaluation and Feedback for Agentic Software Debugging

Large language models (LLMs) are increasingly being incorporated into software engineering workflows, including automated program repair. However, generating a plausible patch is not sufficient to establish that a repair is correct. The senior capstone project associated with this proposal develops and agentic software debugger and documenter in Python using Google ADK, with an Analyst Agent, a Fixer LoopAgent, deterministic validation through syntax checks, Ruff/Pylint, and Pytest when tests are available, and a Documentation Agent. My extension (honors portion) of the project, extends that system with an LLM-based Evaluation and Feedback Layer. Rather than replacing deterministic validation or adding another repair loop, the proposed layer will interpret evidence produced by each repair attempt, classify unresolved failure, assess possible regressions, identify root causes, and return structured feedback that can be consumed by the existing Fixer.

Authors

Institutions

Publication Details

Journal
DigitalCommons - Kennesaw State University (Kennesaw State University)
Published
2026-11-20
Primary Topic
Software Testing and Debugging Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

1369-UC LLM-Based Evaluation and Feedback for Agentic Software Debugging

Douglas Tanaynyiwa
DigitalCommons - Kennesaw State University (Kennesaw State University)
Software Testing and Debugging Techniques
article

1369-UC LLM-Based Evaluation and Feedback for Agentic Software Debugging

Douglas Tanaynyiwa
article en

Abstract

Large language models (LLMs) are increasingly being incorporated into software engineering workflows, including automated program repair. However, generating a plausible patch is not sufficient to establish that a repair is correct. The senior capstone project associated with this proposal develops and agentic software debugger and documenter in Python using Google ADK, with an Analyst Agent, a Fixer LoopAgent, deterministic validation through syntax checks, Ruff/Pylint, and Pytest when tests are available, and a Documentation Agent. My extension (honors portion) of the project, extends that system with an LLM-based Evaluation and Feedback Layer. Rather than replacing deterministic validation or adding another repair loop, the proposed layer will interpret evidence produced by each repair attempt, classify unresolved failure, assess possible regressions, identify root causes, and return structured feedback that can be consumed by the existing Fixer.

DigitalCommons - Kennesaw State University (Kennesaw State University)
Kennesaw State University (US)
Software Testing and Debugging Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
1369-UC LLM-Based Evaluation and Feedback for Agentic Software Debugging — Douglas Tanaynyiwa · DigitalCommons - Kennesaw State University (Kennesaw State University) (2026) | TGRS Research Map | TGRS