Generating trustworthy and context-aware explanations for autonomous robots using an LLM agent-based RAG architecture

• Agent-Based RAG Architecture with Event-Driven Data for Explainable Robots. • A scalable, efficient, decoupled, and adaptive solution for robot explanations. • Review of XAI in robotics, LLMs in XARs, and LLM evaluation approaches. • Empirical results showing accurate robot explanations in various scenarios. • Future work on grounded explanations for autonomous agents. Effective communication in Human-Robot Interaction (HRI) is essential for building trust in autonomous systems. Robotic agents must provide clear, factual explanations that help non-expert users understand their decisions and actions, thereby promoting transparency and acceptance. However, generating structured, contextually relevant, and well-reasoned explanations remains a significant challenge, especially in dynamic environments, where rapidly changing circumstances make it difficult to ensure accuracy, consistency, and timeliness. To address this problem, we propose an architecture that generates natural language explanations grounded in accountable agent data. A distributed event streaming platform captures and processes high-volume system data in real time, which is then used by an agent-based Retrieval-Augmented Generation (RAG) approach to produce accurate and context-aware explanations. By decoupling explanation generation from the robot’s onboard resources, the architecture enables scalable and efficient reasoning while minimizing computational overhead. Experiments on robotic navigation tasks demonstrate that the system achieves high performance across quantitative metrics, with Context Recall consistently above 85%, Faithfulness over 78%, and Semantic Similarity near 96%. Criteria-based evaluations show high levels of Correctness (97.5-100%), with scores for Understandability, Informativeness, and Coherence exceeding 4.0 on a 5-point scale. These results provide strong evidence that integrating curated real-time data with agent-based reasoning enhances the interpretability, reliability, and user trust in autonomous robot behavior.

Authors

Institutions

Publication Details

Journal
Expert Systems with Applications
Published
2026-04-26
DOI
https://doi.org/10.1016/j.eswa.2026.132631
Primary Topic
Explainable Artificial Intelligence (XAI)
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Generating trustworthy and context-aware explanations for autonomous robots using an LLM agent-based RAG architecture

Francisco J. Rodríguez-Lera, Ángel Manuel Guerrero‐Higueras, Laura Fernández-Becerra, Vicente Matellán Olivera
Expert Systems with Applications
Explainable Artificial Intelligence (XAI)
article

Generating trustworthy and context-aware explanations for autonomous robots using an LLM agent-based RAG architecture

Francisco J. Rodríguez-Lera, Ángel Manuel Guerrero‐Higueras, Laura Fernández-Becerra, Vicente Matellán Olivera
article en

Abstract

• Agent-Based RAG Architecture with Event-Driven Data for Explainable Robots. • A scalable, efficient, decoupled, and adaptive solution for robot explanations. • Review of XAI in robotics, LLMs in XARs, and LLM evaluation approaches. • Empirical results showing accurate robot explanations in various scenarios. • Future work on grounded explanations for autonomous agents. Effective communication in Human-Robot Interaction (HRI) is essential for building trust in autonomous systems. Robotic agents must provide clear, factual explanations that help non-expert users understand their decisions and actions, thereby promoting transparency and acceptance. However, generating structured, contextually relevant, and well-reasoned explanations remains a significant challenge, especially in dynamic environments, where rapidly changing circumstances make it difficult to ensure accuracy, consistency, and timeliness. To address this problem, we propose an architecture that generates natural language explanations grounded in accountable agent data. A distributed event streaming platform captures and processes high-volume system data in real time, which is then used by an agent-based Retrieval-Augmented Generation (RAG) approach to produce accurate and context-aware explanations. By decoupling explanation generation from the robot’s onboard resources, the architecture enables scalable and efficient reasoning while minimizing computational overhead. Experiments on robotic navigation tasks demonstrate that the system achieves high performance across quantitative metrics, with Context Recall consistently above 85%, Faithfulness over 78%, and Semantic Similarity near 96%. Criteria-based evaluations show high levels of Correctness (97.5-100%), with scores for Understandability, Informativeness, and Coherence exceeding 4.0 on a 5-point scale. These results provide strong evidence that integrating curated real-time data with agent-based reasoning enhances the interpretability, reliability, and user trust in autonomous robot behavior.

Expert Systems with ApplicationsVol. 325
Universidad de León (ES)
Instituto Nacional de Ciberseguridad
Openalex Percentile: Top 14%
Explainable Artificial Intelligence (XAI)
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.