Towards AI-Assisted Motorcycle Safety: Multi-Modal Video Analysis for Hazard Detection and Contextual Risk Assessment

Motorcyclists face a disproportionately high risk of severe injury or death compared to other road users, highlighting the need for intelligent rider assistance technologies. This paper presents an initial, modular, and interpretable AI pipeline that generates context-aware safety advice from first-person motorcycle videos with practical inference latency suitable for on-device deployment, framing large language models as interpretable cognitive support agents for motorcycle safety. The system integrates lightweight perception and reasoning components to emulate the function of an Advanced Rider Assistance System (ARAS). Video frames are processed at 1 FPS using Pixtral, a Mistral-based multimodal large language model (MLLM), to produce descriptive scene captions, while YOLOv8 identifies key objects such as vehicles, pedestrians, and road hazards. A Mistral-small language model then fuses this information to generate concise, imperative safety tips. Preliminary evaluations on publicly available motorcycle POV datasets demonstrate promising performance in terms of contextual accuracy, interpretability, and scalability, suggesting potential for real-world deployment in low-resource or embedded environments. The proposed framework offers interpretable, context-aware safety assistance that is particularly valuable for young and newly licensed riders during the transition from supervised training to independent riding, where real-time hazard interpretation support is most needed.

Authors

Institutions

Publication Details

Journal
Vehicles
Published
2026-02-13
DOI
https://doi.org/10.3390/vehicles8020039
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Towards AI-Assisted Motorcycle Safety: Multi-Modal Video Analysis for Hazard Detection and Contextual Risk Assessment

Mohammed Elhenawy, Fatemeh Ghorbani, Andry Rakotonirainy, Augustin Hym
Vehicles
Multimodal Machine Learning Applications
article

Towards AI-Assisted Motorcycle Safety: Multi-Modal Video Analysis for Hazard Detection and Contextual Risk Assessment

Mohammed Elhenawy, Fatemeh Ghorbani, Andry Rakotonirainy, Augustin Hym
article en

Abstract

Motorcyclists face a disproportionately high risk of severe injury or death compared to other road users, highlighting the need for intelligent rider assistance technologies. This paper presents an initial, modular, and interpretable AI pipeline that generates context-aware safety advice from first-person motorcycle videos with practical inference latency suitable for on-device deployment, framing large language models as interpretable cognitive support agents for motorcycle safety. The system integrates lightweight perception and reasoning components to emulate the function of an Advanced Rider Assistance System (ARAS). Video frames are processed at 1 FPS using Pixtral, a Mistral-based multimodal large language model (MLLM), to produce descriptive scene captions, while YOLOv8 identifies key objects such as vehicles, pedestrians, and road hazards. A Mistral-small language model then fuses this information to generate concise, imperative safety tips. Preliminary evaluations on publicly available motorcycle POV datasets demonstrate promising performance in terms of contextual accuracy, interpretability, and scalability, suggesting potential for real-world deployment in low-resource or embedded environments. The proposed framework offers interpretable, context-aware safety assistance that is particularly valuable for young and newly licensed riders during the transition from supervised training to independent riding, where real-time hazard interpretation support is most needed.

VehiclesVol. 8(2)
Queensland University of Technology (AU)
Openalex Percentile: Top 57%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Towards AI-Assisted Motorcycle Safety: Multi-Modal Video Analysis for Hazard Detection and Contextual Risk Assessment — Mohammed Elhenawy, Fatemeh Ghorbani, et al. · Vehicles (2026) | TGRS Research Map | TGRS