Multimodal Vision-Language-Action (VLA) Models in Embodied AI and Robotic Manipulation: Architectures, Cross-Embodiment Generalization, and Closed-Loop Latency Bounds

Abstract—Embodied Artificial Intelligence (AI) and autonomous robotic manipulation are undergoing an architectural paradigm shift from narrow, task-specific behavioral cloning policies toward generalist Multimodal Vision-Language-Action (VLA) foundation models. Pre-trained on Internet-scale vision-language corpora and fine-tuned across multi-robot demonstration datasets (e.g., Open X-Embodiment), VLA models—exemplified by RT-2, Octo, and OpenVLA—perceive high-resolution RGB-D sensor streams, process unstructured natural language instructions, and autoregressively predict or diffuse continuous 7-DoF robotic end-effector trajectories. However, translating disembodied multimodal foundation models into physical cyber-physical control fabrics introduces profound physical and computational bottlenecks: continuous action space tokenization discretization errors, severe cross-embodiment kinematic domain shifts across diverse robotic morphologies, closed-loop dynamic instability induced by non-deterministic neural inference latencies (>100 ms), and safety-critical execution failure modes. This paper presents an exhaustive, mathematically formal technical investigation and empirical benchmark of VLA models for robotic manipulation. We formalize the Markov Decision Process (MDP) bridging autoregressive tokenization with continuous trajectory diffusion policies, model cross-embodiment action normalization across disparate robotic arm kinematics, and derive Lyapunov-Krasovskii stability bounds under stochastic computational transport delays. Furthermore, we construct an empirical robotic evaluation testbed across physical Franka Emika Panda and simulated robotic workcells evaluating 600 complex manipulation trials spanning multi-stage semantic reasoning, spatial tool use, and long-horizon pick-and-place tasks. Our empirical findings demonstrate that continuous diffusion-policy action chunking achieves an 84.6% task success rate, outperforming discrete tokenization by 28.2% while reducing kinematic jerk by 62.4%. Concurrently, asynchronous visual-action decoupling bounds closed-loop inference latency within a deterministic 20 Hz control cycle. Finally, we formulate open research directions in tactile-integrated multi-modal perception, formal barrier certificates for physical safety, and self-supervised real-world policy refinement. Index Terms—Vision-Language-Action (VLA) Models, Embodied AI, Robotic Manipulation, Diffusion Policy, Action Tokenization, Cross-Embodiment Generalization, Open X-Embodiment, Closed-Loop Control Latency.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-13
DOI
https://doi.org/10.5281/zenodo.23337818
Primary Topic
Robot Manipulation and Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal Vision-Language-Action (VLA) Models in Embodied AI and Robotic Manipulation: Architectures, Cross-Embodiment Generalization, and Closed-Loop Latency Bounds

Vishal Shrivastava, Vibhakar Pathak, Aryan jangid, Arnav Bansal et al.
Zenodo (CERN European Organization for Nuclear Research)
Robot Manipulation and Learning
article

Multimodal Vision-Language-Action (VLA) Models in Embodied AI and Robotic Manipulation: Architectures, Cross-Embodiment Generalization, and Closed-Loop Latency Bounds

Vishal Shrivastava, Vibhakar Pathak, Aryan jangid, Arnav Bansal, Mukesh Mishra
article en

Abstract

Abstract—Embodied Artificial Intelligence (AI) and autonomous robotic manipulation are undergoing an architectural paradigm shift from narrow, task-specific behavioral cloning policies toward generalist Multimodal Vision-Language-Action (VLA) foundation models. Pre-trained on Internet-scale vision-language corpora and fine-tuned across multi-robot demonstration datasets (e.g., Open X-Embodiment), VLA models—exemplified by RT-2, Octo, and OpenVLA—perceive high-resolution RGB-D sensor streams, process unstructured natural language instructions, and autoregressively predict or diffuse continuous 7-DoF robotic end-effector trajectories. However, translating disembodied multimodal foundation models into physical cyber-physical control fabrics introduces profound physical and computational bottlenecks: continuous action space tokenization discretization errors, severe cross-embodiment kinematic domain shifts across diverse robotic morphologies, closed-loop dynamic instability induced by non-deterministic neural inference latencies (>100 ms), and safety-critical execution failure modes. This paper presents an exhaustive, mathematically formal technical investigation and empirical benchmark of VLA models for robotic manipulation. We formalize the Markov Decision Process (MDP) bridging autoregressive tokenization with continuous trajectory diffusion policies, model cross-embodiment action normalization across disparate robotic arm kinematics, and derive Lyapunov-Krasovskii stability bounds under stochastic computational transport delays. Furthermore, we construct an empirical robotic evaluation testbed across physical Franka Emika Panda and simulated robotic workcells evaluating 600 complex manipulation trials spanning multi-stage semantic reasoning, spatial tool use, and long-horizon pick-and-place tasks. Our empirical findings demonstrate that continuous diffusion-policy action chunking achieves an 84.6% task success rate, outperforming discrete tokenization by 28.2% while reducing kinematic jerk by 62.4%. Concurrently, asynchronous visual-action decoupling bounds closed-loop inference latency within a deterministic 20 Hz control cycle. Finally, we formulate open research directions in tactile-integrated multi-modal perception, formal barrier certificates for physical safety, and self-supervised real-world policy refinement. Index Terms—Vision-Language-Action (VLA) Models, Embodied AI, Robotic Manipulation, Diffusion Policy, Action Tokenization, Cross-Embodiment Generalization, Open X-Embodiment, Closed-Loop Control Latency.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 17%
Robot Manipulation and Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.