Framework for Assessing Situational Awareness in Beyond Visual Line of Sight UAV Operations

We present an Unmanned Aerial Vehicle (UAV) human-robot interaction simulation environment to evaluate operator situational awareness (SA) during Beyond Visual Line of Sight (BVLOS) operations. We have developed a modular simulator that functions as a testbed for the design of custom scenarios and the study of human-robot interaction. This simulator facilitates data collection and allows for the comparative analysis of various interface designs in terms of their effectiveness in enhancing users' acquisition of situational awareness. We implemented three operational scenarios and corresponding assessment questions via real-time SA probes specifically tailored for teleoperator roles with a combination of flight data and user interaction logs. We conducted initial usability tests and received feedback on the potential use of the setup in training teleoperators and designing UAV scenarios. The insights obtained from these pilot evaluations and further, planned, studies can benefit interface design processes that improve operator situational awareness.