Smart&Safe Mobility Lab: Mixed Reality Environment with HIL, CV2X for VRU Detection

This work proposes the development of a Mixed Reality Environment (MRE) designed to facilitate Hardware-in-the-Loop (HIL) testing through the simulation of Advanced Driver Assistance Systems (ADAS). The proposed infrastructure will enable the connection of a vehicle to a simulator, which will project images of the virtual environment onto a surface, providing the driver with an immersive experience while oper-ating the connected vehicle. The developed infrastructure will have the capability to directly acquire data from various types of simulated sensor models commonly used in ADAS systems, such as cameras, RADARs, and LiDARs. This setup will be instrumental in evaluating and studying user experience by analyzing driver behavior in response to different interfaces and alert systems. Additionally, the vehicle will be integrated into the vehicular communication network, allowing for comprehensive hardware and software testing in scenarios that pose risks to the physical integrity of the driver and Vulnerable Road Users (VRUs), such as vehicle collisions and areas with frequent VRU crossings.