A Methodology for Verifying and Validating the Functional Performance Evaluation of High-Fidelity RADAR Sensor Models at Raw Data and Detection Levels

This paper outlines a comprehensive methodology for verifying and validating the functional performance evaluation of high-fidelity radio detection and ranging (RADAR) sensor models at both the raw data level, specifically the range map (RM) and range-Doppler map (RDM), and the detection level. Three key performance parameters (KPPs) are defined at the raw data level: the target's received power, signal-to-noise ratio (SNR), and twoway beam pattern. Four KPPs are identified at the detection level: distance, relative radial velocity, azimuth angle, and elevation angle. This study also introduces three dynamic test scenarios directly applicable to the functional evaluation assessment of RADAR sensor models. Furthermore, a toolchain is presented to integrate real-world test scenarios into the virtual environment, allowing for frame-by-frame validation of the RADAR sensor models' functional evaluation. Quantitative analysis successfully assesses differences between simulations and real measurements, employing the mean absolute percentage error (MAPE) metric. This methodology has been successfully applied to a high-fidelity RADAR sensor model featuring a multiple input and multiple output (MIMO) 2D linear spacing virtual antenna and a complete signal processing toolchain that mimics real RADAR sensors. Results show a strong correlation between the simulation and real measurements, with MAPE values below 7 % for all defined KPPs at raw data and detection levels. Using this methodology, developers can assess whether virtual RADAR sensors are ready for environmental perception during scenario-based automated driving system (ADS) testing.

Authors

Institutions

Publication Details

Published
2024-12-27
DOI
https://doi.org/10.1109/icvisp64524.2024.10959585
Citations
1
Primary Topic
Infrared Target Detection Methodologies
Type
article
Field-Weighted Citation Impact
1.30
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Methodology for Verifying and Validating the Functional Performance Evaluation of High-Fidelity RADAR Sensor Models at Raw Data and Detection Levels

Martin Jakobi, Abdülkadir Eryıldırım, Nils Müllner, Thomas Zeh et al.
1 citations
Infrared Target Detection Methodologies
1.30
article

A Methodology for Verifying and Validating the Functional Performance Evaluation of High-Fidelity RADAR Sensor Models at Raw Data and Detection Levels

Martin Jakobi, Abdülkadir Eryıldırım, Nils Müllner, Thomas Zeh, Arsalan Haider, Lukas Haas, Shotaro Koyama, Alexander Koch
article en
1 citations

Abstract

This paper outlines a comprehensive methodology for verifying and validating the functional performance evaluation of high-fidelity radio detection and ranging (RADAR) sensor models at both the raw data level, specifically the range map (RM) and range-Doppler map (RDM), and the detection level. Three key performance parameters (KPPs) are defined at the raw data level: the target's received power, signal-to-noise ratio (SNR), and twoway beam pattern. Four KPPs are identified at the detection level: distance, relative radial velocity, azimuth angle, and elevation angle. This study also introduces three dynamic test scenarios directly applicable to the functional evaluation assessment of RADAR sensor models. Furthermore, a toolchain is presented to integrate real-world test scenarios into the virtual environment, allowing for frame-by-frame validation of the RADAR sensor models' functional evaluation. Quantitative analysis successfully assesses differences between simulations and real measurements, employing the mean absolute percentage error (MAPE) metric. This methodology has been successfully applied to a high-fidelity RADAR sensor model featuring a multiple input and multiple output (MIMO) 2D linear spacing virtual antenna and a complete signal processing toolchain that mimics real RADAR sensors. Results show a strong correlation between the simulation and real measurements, with MAPE values below 7 % for all defined KPPs at raw data and detection levels. Using this methodology, developers can assess whether virtual RADAR sensors are ready for environmental perception during scenario-based automated driving system (ADS) testing.

Kanagawa Institute of Technology (JP), Kempten University of Applied Sciences (DE), Deutsches Zentrum für Luft- und Raumfahrt e. V. (DLR) (DE), Infineon Technologies (Austria) (AT), Technical University of Munich (DE)
Affordable and clean energy
Openalex Percentile: Top 10%
Infrared Target Detection Methodologies
1.30
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.