A Game-Theoretic Model of Trust in Human–Robot Teaming: Guiding Human Observation Strategy for Monitoring Robot Behavior

In scenarios involving robots generating and executing plans, conflicts can arise between cost-effective robot execution and meeting human expectations for safe behavior. When humans supervise robots, their accountability increases, especially when robot behavior deviates from expectations. To address this, robots may choose a highly constrained plan when monitored and a more optimal one when unobserved. While this behavior is not driven by human-like motives, it stems from robots accommodating diverse supervisors. To optimize monitoring costs while ensuring safety, we model this interaction in a trust-based game-theoretic framework. However, pure-strategy Nash equilibrium often fails to exist in this model. To address this, we introduce the concept of a trust boundary within the mixed strategy space, aiding in the discovery of optimal monitoring strategies. Human studies demonstrate the necessity of optimal strategies and the benefits of our suggested approaches.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Human-Machine Systems
Published
2024-12-04
DOI
https://doi.org/10.1109/thms.2024.3488559
Citations
2
Primary Topic
Human-Automation Interaction and Safety
Type
article
Field-Weighted Citation Impact
1.29

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Game-Theoretic Model of Trust in Human–Robot Teaming: Guiding Human Observation Strategy for Monitoring Robot Behavior

Zahra Zahedi, Subbarao Kambhampati, Sailik Sengupta
2 citations
IEEE Transactions on Human-Machine Systems
Human-Automation Interaction and Safety
1.29
article

A Game-Theoretic Model of Trust in Human–Robot Teaming: Guiding Human Observation Strategy for Monitoring Robot Behavior

Zahra Zahedi, Subbarao Kambhampati, Sailik Sengupta
article en
2 citations

Abstract

In scenarios involving robots generating and executing plans, conflicts can arise between cost-effective robot execution and meeting human expectations for safe behavior. When humans supervise robots, their accountability increases, especially when robot behavior deviates from expectations. To address this, robots may choose a highly constrained plan when monitored and a more optimal one when unobserved. While this behavior is not driven by human-like motives, it stems from robots accommodating diverse supervisors. To optimize monitoring costs while ensuring safety, we model this interaction in a trust-based game-theoretic framework. However, pure-strategy Nash equilibrium often fails to exist in this model. To address this, we introduce the concept of a trust boundary within the mixed strategy space, aiding in the discovery of optimal monitoring strategies. Human studies demonstrate the necessity of optimal strategies and the benefits of our suggested approaches.

IEEE Transactions on Human-Machine SystemsVol. 55(1)
Arizona State University (US)
Office of Naval Research
Openalex Percentile: Top 17%
Human-Automation Interaction and Safety
1.29
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.