Trusting a Disobedient Robot: Rejecting a Command for Constructive Reasons Improves Evaluations of Trust

Increasing autonomy and anticipation of the prevalence of human-robot teams has lead to focus on how humans trust robots. Additionally, some researchers argue that robots should be capable of intelligent disobedience, either in situations of epistemic misalignment (i.e., situational misunderstanding) or normative conflict (i.e., when obedience to normative principle supersedes compliance). Little work exists on the effects of robot disobedience on trust, and what does exist focuses primarily on normative conflict scenarios. Here we present novel results showing differences in trust evaluations between robots that exhibit strict obedience to commands versus those that exhibit intelligent disobedience. Specifically, we report on a vignette-based study designed to test the effect of intelligent disobedience by a robotic agent on evaluations of trust in situations of epistemic misalignment.

Authors

Institutions

Publication Details

Published
2025-03-04
DOI
https://doi.org/10.1109/hri61500.2025.10974061
Citations
3
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
7.10
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Trusting a Disobedient Robot: Rejecting a Command for Constructive Reasons Improves Evaluations of Trust

Gordon Briggs, Christina Wasylyshyn
3 citations
Ethics and Social Impacts of AI
7.10
article

Trusting a Disobedient Robot: Rejecting a Command for Constructive Reasons Improves Evaluations of Trust

Gordon Briggs, Christina Wasylyshyn
article en
3 citations

Abstract

Increasing autonomy and anticipation of the prevalence of human-robot teams has lead to focus on how humans trust robots. Additionally, some researchers argue that robots should be capable of intelligent disobedience, either in situations of epistemic misalignment (i.e., situational misunderstanding) or normative conflict (i.e., when obedience to normative principle supersedes compliance). Little work exists on the effects of robot disobedience on trust, and what does exist focuses primarily on normative conflict scenarios. Here we present novel results showing differences in trust evaluations between robots that exhibit strict obedience to commands versus those that exhibit intelligent disobedience. Specifically, we report on a vignette-based study designed to test the effect of intelligent disobedience by a robotic agent on evaluations of trust in situations of epistemic misalignment.

United States Naval Research Laboratory (US)
Reduced inequalities
Openalex Percentile: Top 3%
Ethics and Social Impacts of AI
7.10
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.