Specification, validation and verification of social, legal, ethical, empathetic and cultural requirements for autonomous agents

Autonomous agents are increasingly being proposed for use in healthcare, assistive care, education, and other applications governed by complex human-centric norms. To ensure compliance with these norms, the rules they induce need to be unambiguously defined, checked for consistency, and used to verify the agent. In this paper, we introduce a framework for formal specification, validation and verification of social, legal, ethical, empathetic and cultural (SLEEC) rules for autonomous agents. Our framework comprises: (i) a language for specifying SLEEC rules and rule defeaters (that is, circumstances in which a rule does not apply or an alternative form of the rule is required); (ii) a formal semantics (defined in the process algebra tock-CSP) for the language; and (iii) methods for detecting conflicts and redundancy within a set of rules, and for verifying the compliance of an autonomous agent with such rules. We show the applicability of our framework for two autonomous agents from different domains: a firefighter UAV, and an assistive-dressing robot. • A formal approach to specifying, validating and verifying normative requirements. • A domain-specific language with formal semantics for normative requirements. • End-to-end tool support for normative requirements engineering. • Case studies showing applicability to a firefighter drone and an assistive-care robot.

Authors

Institutions

Publication Details

Journal
Journal of Systems and Software
Published
2024-10-05
DOI
https://doi.org/10.1016/j.jss.2024.112229
Citations
4
Primary Topic
Robot Manipulation and Learning
Type
article
Field-Weighted Citation Impact
1.31

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Specification, validation and verification of social, legal, ethical, empathetic and cultural requirements for autonomous agents

Radu Călinescu, Pedro Ribeiro, Beverley Townsend, Sinem Getir Yaman et al.
4 citations
Journal of Systems and Software
Robot Manipulation and Learning
1.31
article

Specification, validation and verification of social, legal, ethical, empathetic and cultural requirements for autonomous agents

Radu Călinescu, Pedro Ribeiro, Beverley Townsend, Sinem Getir Yaman, Colin Paterson, Ana Cavalcanti
article en
4 citations

Abstract

Autonomous agents are increasingly being proposed for use in healthcare, assistive care, education, and other applications governed by complex human-centric norms. To ensure compliance with these norms, the rules they induce need to be unambiguously defined, checked for consistency, and used to verify the agent. In this paper, we introduce a framework for formal specification, validation and verification of social, legal, ethical, empathetic and cultural (SLEEC) rules for autonomous agents. Our framework comprises: (i) a language for specifying SLEEC rules and rule defeaters (that is, circumstances in which a rule does not apply or an alternative form of the rule is required); (ii) a formal semantics (defined in the process algebra tock-CSP) for the language; and (iii) methods for detecting conflicts and redundancy within a set of rules, and for verifying the compliance of an autonomous agent with such rules. We show the applicability of our framework for two autonomous agents from different domains: a firefighter UAV, and an assistive-dressing robot. • A formal approach to specifying, validating and verifying normative requirements. • A domain-specific language with formal semantics for normative requirements. • End-to-end tool support for normative requirements engineering. • Case studies showing applicability to a firefighter drone and an assistive-care robot.

Journal of Systems and SoftwareVol. 220
University of York (GB)
UK Research and Innovation, Royal Academy of Engineering, Engineering and Physical Sciences Research Council
Reduced inequalities
Openalex Percentile: Top 19%
Robot Manipulation and Learning
1.31
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.