Integrating Belief-Desire-Intention agents with large language models for reliable human–robot interaction and explainable Artificial Intelligence

This paper presents the development of an innovative communication interface between humans and robots, designed for human-in-the-loop interaction with a user interface through natural language. The novelty of the presented approach lies in integration of a Belief-Desire-Intention agent, communicating directly to a robot and ensuring safety properties and verifiable decision making, with large language models that excel in language understanding and generation. We establish a framework that leverages the strengths of both paradigms by allowing users to formulate commands in natural language, using the ability of large language models to interpret and ground them into actionable goals, with the proven ability of Belief-Desire Intention agents to perform verifiable reasoning and goal management. In addition, we utilize the ability of this agent to represent and store its mind state, including its belief base, plan library, and history of selected events and actions, to allow large language models based explanations of the system behavior. Our findings demonstrate that this architecture provides several benefits in terms of performance and safety, without impacting efficiency or requiring extensive integration effort. This research contributes a novel perspective on the combination of large language models with symbolic approaches for explainable Artificial Intelligence and aims at inspiring new developments in human-centered Artificial Intelligence systems.

Authors

Institutions

Publication Details

Journal
Engineering Applications of Artificial Intelligence
Published
2024-12-13
DOI
https://doi.org/10.1016/j.engappai.2024.109771
Citations
28
Primary Topic
Explainable Artificial Intelligence (XAI)
Type
article
Field-Weighted Citation Impact
9.73

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Integrating Belief-Desire-Intention agents with large language models for reliable human–robot interaction and explainable Artificial Intelligence

Andreas Holzinger, Laurent Frering, Gerald Steinbauer-Wagner
28 citations
Engineering Applications of Artificial Intelligence
Explainable Artificial Intelligence (XAI)
9.73
article

Integrating Belief-Desire-Intention agents with large language models for reliable human–robot interaction and explainable Artificial Intelligence

Andreas Holzinger, Laurent Frering, Gerald Steinbauer-Wagner
article en
28 citations

Abstract

This paper presents the development of an innovative communication interface between humans and robots, designed for human-in-the-loop interaction with a user interface through natural language. The novelty of the presented approach lies in integration of a Belief-Desire-Intention agent, communicating directly to a robot and ensuring safety properties and verifiable decision making, with large language models that excel in language understanding and generation. We establish a framework that leverages the strengths of both paradigms by allowing users to formulate commands in natural language, using the ability of large language models to interpret and ground them into actionable goals, with the proven ability of Belief-Desire Intention agents to perform verifiable reasoning and goal management. In addition, we utilize the ability of this agent to represent and store its mind state, including its belief base, plan library, and history of selected events and actions, to allow large language models based explanations of the system behavior. Our findings demonstrate that this architecture provides several benefits in terms of performance and safety, without impacting efficiency or requiring extensive integration effort. This research contributes a novel perspective on the combination of large language models with symbolic approaches for explainable Artificial Intelligence and aims at inspiring new developments in human-centered Artificial Intelligence systems.

Engineering Applications of Artificial IntelligenceVol. 141
Machine Intelligence Research Institute (US), Graz University of Technology (AT), BOKU University (AT)
Gesellschaft für Forschungsförderung Niederösterreich, Austrian Science Fund
Reduced inequalities
Openalex Percentile: Top 2%
Explainable Artificial Intelligence (XAI)
9.73
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.