VLA-Edge: An Edge-Deployed Vision-Language Model Framework for Autonomous Robotic Manipulation via Agentic Reasoning

The deployment of large language models in robotic manipulation has largely relied on cloud-based inference, introducing latency, privacy risks, and network dependency. This paper presents VLA-Edge, a fully offline, edge-deployed framework that runs a 2-billion parameter Vision-Language Model (B01X-2B-Edge-Robotics) natively on Apple Silicon using the MLX framework. At its core is a ReAct-based agentic loop that enables a 6-DOF robotic arm to interpret natural language commands, perceive its workspace via RGB camera, and autonomously execute multi-step pick-and-place tasks. Supporting components include an ArUco marker-based homography pipeline for accurate pixel-to-millimeter transformation and a Three.js digital twin for visualization and safety. Experimental results show end-to-end single-step task completion in under 2.1 seconds while maintaining complete data privacy, zero cloud cost, and full offline operation. This is a preprint. The work is currently under review / submitted to a conference.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-05-27
DOI
https://doi.org/10.5281/zenodo.20406011
Primary Topic
Multimodal Machine Learning Applications
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

VLA-Edge: An Edge-Deployed Vision-Language Model Framework for Autonomous Robotic Manipulation via Agentic Reasoning

R. Narmadha, Naveenbalaji S, S K Gokulbarath
Zenodo (CERN European Organization for Nuclear Research)
Multimodal Machine Learning Applications
preprint

VLA-Edge: An Edge-Deployed Vision-Language Model Framework for Autonomous Robotic Manipulation via Agentic Reasoning

R. Narmadha, Naveenbalaji S, S K Gokulbarath
preprint en

Abstract

The deployment of large language models in robotic manipulation has largely relied on cloud-based inference, introducing latency, privacy risks, and network dependency. This paper presents VLA-Edge, a fully offline, edge-deployed framework that runs a 2-billion parameter Vision-Language Model (B01X-2B-Edge-Robotics) natively on Apple Silicon using the MLX framework. At its core is a ReAct-based agentic loop that enables a 6-DOF robotic arm to interpret natural language commands, perceive its workspace via RGB camera, and autonomously execute multi-step pick-and-place tasks. Supporting components include an ArUco marker-based homography pipeline for accurate pixel-to-millimeter transformation and a Three.js digital twin for visualization and safety. Experimental results show end-to-end single-step task completion in under 2.1 seconds while maintaining complete data privacy, zero cloud cost, and full offline operation. This is a preprint. The work is currently under review / submitted to a conference.

Zenodo (CERN European Organization for Nuclear Research)
Sathyabama Institute of Science and Technology (IN)
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.