Towards Automated Safety Requirements Derivation Using Agent-based RAG

We study the automated derivation of safety requirements in a self-driving vehicle use case, leveraging LLMs in combination with agent-based retrieval-augmented generation. Conventional approaches that utilise pre-trained LLMs to assist in safety analyses typically lack domain-specific knowledge. Existing RAG approaches address this issue, yet their performance deteriorates when handling complex queries and it becomes increasingly harder to retrieve the most relevant information. This is particularly relevant for safety-relevant applications. In this paper, we propose the use of agent-based RAG to derive safety requirements and show that the retrieved information is more relevant to the queries. We implement an agent-based approach on a document pool of automotive standards and the Apollo case study, as a representative example of an automated driving perception system. Our solution is tested on a data set of safety requirement questions and answers, extracted from the Apollo data. Evaluating a set of selected RAG metrics, we present and discuss advantages of a agent-based approach compared to default RAG methods.

Authors

Institutions

Publication Details

Journal
Proceedings of the AAAI Symposium Series
Published
2025-05-28
DOI
https://doi.org/10.1609/aaaiss.v5i1.35605
Citations
2
Primary Topic
Safety Systems Engineering in Autonomy
Type
article
Field-Weighted Citation Impact
2.61
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Towards Automated Safety Requirements Derivation Using Agent-based RAG

R. Stollé, João-Vitor Zacchi, Florian Geißler, Francesco Carella et al.
2 citations
Proceedings of the AAAI Symposium Series
Safety Systems Engineering in Autonomy
2.61
article

Towards Automated Safety Requirements Derivation Using Agent-based RAG

R. Stollé, João-Vitor Zacchi, Florian Geißler, Francesco Carella, Núria Mata, Balahari Vignesh Balu, Josef Jiru
article en
2 citations

Abstract

We study the automated derivation of safety requirements in a self-driving vehicle use case, leveraging LLMs in combination with agent-based retrieval-augmented generation. Conventional approaches that utilise pre-trained LLMs to assist in safety analyses typically lack domain-specific knowledge. Existing RAG approaches address this issue, yet their performance deteriorates when handling complex queries and it becomes increasingly harder to retrieve the most relevant information. This is particularly relevant for safety-relevant applications. In this paper, we propose the use of agent-based RAG to derive safety requirements and show that the retrieved information is more relevant to the queries. We implement an agent-based approach on a document pool of automotive standards and the Apollo case study, as a representative example of an automated driving perception system. Our solution is tested on a data set of safety requirement questions and answers, extracted from the Apollo data. Evaluating a set of selected RAG metrics, we present and discuss advantages of a agent-based approach compared to default RAG methods.

Proceedings of the AAAI Symposium SeriesVol. 5(1)
Fraunhofer Institute for Cognitive Systems (DE)
Openalex Percentile: Top 11%
Safety Systems Engineering in Autonomy
2.61
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.