Robot Competency Self-Assessments for Assured Mission Management in Uncertain Environments

Calibrating users to the capabilities and limitations of their autonomous robotic partners is crucial for successful human-robot teaming. User inexperience, mission complexities, and degradation of the robot over time can impact user decision-making and lead to ineffective use of the robot. This can spell disaster in high-risk and uncertain environments like space exploration. In this paper, we explore how to mitigate such risks by enabling robots to quantify and communicate estimates of their competencies to human partners. Specifically, we investigated robot competency information in the context of a complex planetary exploration analogue mission in which a human had to balance monitoring an autonomous mobile robot with attending to a concurrent task. Leveraging the Factorized Machine Self-Confidence framework for robot competency self-assessment, we varied the robot’s ability to report competency. We found that human-robot teams whose robot was able to report competency and update that report online demonstrated superior mission performance (30% improvement) compared to baseline methods.

Authors

Institutions

Publication Details

Published
2025-05-29
DOI
https://doi.org/10.1109/eras63351.2025.11135703
Citations
1
Primary Topic
Risk and Safety Analysis
Type
article
Field-Weighted Citation Impact
1.40
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Robot Competency Self-Assessments for Assured Mission Management in Uncertain Environments

Daniel Szafır, Nicholas Conlon, Nisar Ahmed
1 citations
Risk and Safety Analysis
1.40
article

Robot Competency Self-Assessments for Assured Mission Management in Uncertain Environments

Daniel Szafır, Nicholas Conlon, Nisar Ahmed
article en
1 citations

Abstract

Calibrating users to the capabilities and limitations of their autonomous robotic partners is crucial for successful human-robot teaming. User inexperience, mission complexities, and degradation of the robot over time can impact user decision-making and lead to ineffective use of the robot. This can spell disaster in high-risk and uncertain environments like space exploration. In this paper, we explore how to mitigate such risks by enabling robots to quantify and communicate estimates of their competencies to human partners. Specifically, we investigated robot competency information in the context of a complex planetary exploration analogue mission in which a human had to balance monitoring an autonomous mobile robot with attending to a concurrent task. Leveraging the Factorized Machine Self-Confidence framework for robot competency self-assessment, we varied the robot’s ability to report competency. We found that human-robot teams whose robot was able to report competency and update that report online demonstrated superior mission performance (30% improvement) compared to baseline methods.

University of North Carolina at Chapel Hill (US), University of Colorado Boulder (US)
Climate action
Openalex Percentile: Top 14%
Risk and Safety Analysis
1.40
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.