CoSafe: A Cooperative V2V Perception Framework with LLM Reasoning for Hazard Detection on Real Dashcam Data

Cooperative perception through vehicle-to-vehicle (V2V) communication can resolve occlusions that single-vehicle systems cannot overcome, yet existing frameworks rely on simulated environments and expensive multi-sensor platforms. This paper presents CoSafe, a cooperative perception and reasoning framework built on real-world data acquired from dashboard cameras with integrated GPS. CoSafe extends a previously validated image-based positioning algorithm by adding YOLOv8 object detection, cooperative state fusion, Chain-of-Thought reasoning using a Large Language Model, and a deterministic rule-based safety validation layer. The core contribution is a spatial–temporal vehicle matching framework that associates frames captured from overlapping geographic locations at different timestamps, enabling cooperative hazard reasoning across asynchronous and partially observable vehicle streams. This paper also introduces the Cooperation Gain metric to quantify the proportion of cases in which hazard detection depends on inter-vehicle information sharing. On a real-world occluded-pedestrian scenario, cooperation provides an advance warning of at least 1.73 s before the following vehicle’s own detector registers the pedestrian, with a Cooperation Gain of 0.533 measured against manual human annotation. An ablation across single-vehicle, rule-only, and LLM-only configurations isolates the contribution of each component, and a negative-scenario test yields zero false alarms in normal traffic.

Authors

Institutions

Publication Details

Journal
Sensors
Published
2026-09-13
DOI
https://doi.org/10.3390/s26185797
Primary Topic
Autonomous Vehicle Technology and Safety
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

CoSafe: A Cooperative V2V Perception Framework with LLM Reasoning for Hazard Detection on Real Dashcam Data

Constantin F. Caruntu, Paul-Corneliu Herghelegiu, Iosif-Alin Beti
Sensors
Autonomous Vehicle Technology and Safety
article

CoSafe: A Cooperative V2V Perception Framework with LLM Reasoning for Hazard Detection on Real Dashcam Data

Constantin F. Caruntu, Paul-Corneliu Herghelegiu, Iosif-Alin Beti
article en

Abstract

Cooperative perception through vehicle-to-vehicle (V2V) communication can resolve occlusions that single-vehicle systems cannot overcome, yet existing frameworks rely on simulated environments and expensive multi-sensor platforms. This paper presents CoSafe, a cooperative perception and reasoning framework built on real-world data acquired from dashboard cameras with integrated GPS. CoSafe extends a previously validated image-based positioning algorithm by adding YOLOv8 object detection, cooperative state fusion, Chain-of-Thought reasoning using a Large Language Model, and a deterministic rule-based safety validation layer. The core contribution is a spatial–temporal vehicle matching framework that associates frames captured from overlapping geographic locations at different timestamps, enabling cooperative hazard reasoning across asynchronous and partially observable vehicle streams. This paper also introduces the Cooperation Gain metric to quantify the proportion of cases in which hazard detection depends on inter-vehicle information sharing. On a real-world occluded-pedestrian scenario, cooperation provides an advance warning of at least 1.73 s before the following vehicle’s own detector registers the pedestrian, with a Cooperation Gain of 0.533 measured against manual human annotation. An ablation across single-vehicle, rule-only, and LLM-only configurations isolates the contribution of each component, and a negative-scenario test yields zero false alarms in normal traffic.

SensorsVol. 26(18)
Gheorghe Asachi Technical University of Iași (RO)
Openalex Percentile: Top 18%
Autonomous Vehicle Technology and Safety
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.