C-VLA: A Hierarchical Vision-Language-Action Architecture for Energy-Efficient In-Cabin Agentic AI on Automotive Edge Hardware

Driver monitoring systems have traditionally relied on reactive, single-model architectures that continuously invoke large language models regardless of driver intent complexity, resulting in excessive energy consumption and latency unsuitable for automotive edge deployment. We present C-VLA (Cabin Vision-Language-Action), a hierarchical two-brain architecture that decouples reflex gating from agentic reasoning. A lightweight CNN classifier (System 1) processes every frame at 7.9ms and 126.6 FPS on the NVIDIA Jetson Orin Nano Super, invoking a Llama-3.2-1B reasoning module (System 2) only when complex driver intent is detected. Evaluated on the DMD driver monitoring dataset (6,405 frames, 6 classes), System 1 achieves 92.8% accuracy (F1: 91.9%) while reducing LLM invocations by 65% and mean response latency by 97% compared to a single-model baseline. All code and model weights are released publicly. Index Terms—driver monitoring, edge AI, vision-language-action, hierarchical inference, automotive, Jetson Orin Code and model weights available at: https://github.com/devender-sharma-emb/C-VLA-Cabin-AgentModel weights: https://huggingface.co/devvender/cvla-cnn-gatekeeper

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-05-10
DOI
https://doi.org/10.5281/zenodo.20102631
Primary Topic
Autonomous Vehicle Technology and Safety
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

C-VLA: A Hierarchical Vision-Language-Action Architecture for Energy-Efficient In-Cabin Agentic AI on Automotive Edge Hardware

Devender Sharma
Zenodo (CERN European Organization for Nuclear Research)
Autonomous Vehicle Technology and Safety
article

C-VLA: A Hierarchical Vision-Language-Action Architecture for Energy-Efficient In-Cabin Agentic AI on Automotive Edge Hardware

Devender Sharma
article en

Abstract

Driver monitoring systems have traditionally relied on reactive, single-model architectures that continuously invoke large language models regardless of driver intent complexity, resulting in excessive energy consumption and latency unsuitable for automotive edge deployment. We present C-VLA (Cabin Vision-Language-Action), a hierarchical two-brain architecture that decouples reflex gating from agentic reasoning. A lightweight CNN classifier (System 1) processes every frame at 7.9ms and 126.6 FPS on the NVIDIA Jetson Orin Nano Super, invoking a Llama-3.2-1B reasoning module (System 2) only when complex driver intent is detected. Evaluated on the DMD driver monitoring dataset (6,405 frames, 6 classes), System 1 achieves 92.8% accuracy (F1: 91.9%) while reducing LLM invocations by 65% and mean response latency by 97% compared to a single-model baseline. All code and model weights are released publicly. Index Terms—driver monitoring, edge AI, vision-language-action, hierarchical inference, automotive, Jetson Orin Code and model weights available at: https://github.com/devender-sharma-emb/C-VLA-Cabin-AgentModel weights: https://huggingface.co/devvender/cvla-cnn-gatekeeper

Zenodo (CERN European Organization for Nuclear Research)
Affordable and clean energy
Openalex Percentile: Top 8%
Autonomous Vehicle Technology and Safety
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.