Trusting a Disobedient Robot: Rejecting a Command for Constructive Reasons Improves Evaluations of Trust
Increasing autonomy and anticipation of the prevalence of human-robot teams has lead to focus on how humans trust robots. Additionally, some researchers argue that robots should be capable of intelligent disobedience, either in situations of epistemic misalignment (i.e., situational misunderstanding) or normative conflict (i.e., when obedience to normative principle supersedes compliance). Little work exists on the effects of robot disobedience on trust, and what does exist focuses primarily on normative conflict scenarios. Here we present novel results showing differences in trust evaluations between robots that exhibit strict obedience to commands versus those that exhibit intelligent disobedience. Specifically, we report on a vignette-based study designed to test the effect of intelligent disobedience by a robotic agent on evaluations of trust in situations of epistemic misalignment.
Authors
- Gordon Briggs (ORCID: https://orcid.org/0000-0001-8375-3830)
- Christina Wasylyshyn
Institutions
- United States Naval Research Laboratory (US)
Publication Details
- Published
- 2025-03-04
- DOI
- https://doi.org/10.1109/hri61500.2025.10974061
- Citations
- 3
- Primary Topic
- Ethics and Social Impacts of AI
- Type
- article
- Field-Weighted Citation Impact
- 7.10