The evolution of end-to-end Vision-Language-Action (VLA) architectures in robotics

Vision-Language-Action (VLA) models represent a fundamental architectural shift in robotic learning, replacing modular perception-reasoning-control pipelines with unified frameworks that jointly optimize multimodal understanding and motor control. While large language models (LLMs) have enabled natural language grounding in robotics, the core challenge remains how to effectively fuse visual perception, linguistic reasoning, and continuous action generation within a single coherent architecture. This survey provides a systematic decomposition of modern VLA systems into three critical components, including multimodal perception encoders, cross-modal fusion mechanisms, and action decoders. We also critically evaluate the impact of design choices on generalization, sample efficiency, and task complexity. We distinguish two dominant architectural paradigms: end-to-end models that directly map observations to actions through learned representations, and hierarchical models that decompose tasks into explicit planning and execution stages. Through comparative analysis of their trade-offs in zero-shot generalization, interpretability, and long-horizon performance, we identify key open challenges in semantic grounding, spatial reasoning, and sim-to-real transfer that will determine the viability of VLAs for real-world deployment.

Authors

Institutions

Publication Details

Journal
Robot learning.
Published
2026-04-27
DOI
https://doi.org/10.55092/rl20260010
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The evolution of end-to-end Vision-Language-Action (VLA) architectures in robotics

Jiajun An, Daifeng Wang, Xin Ma, Bike Zhu et al.
Robot learning.
Multimodal Machine Learning Applications
article

The evolution of end-to-end Vision-Language-Action (VLA) architectures in robotics

Jiajun An, Daifeng Wang, Xin Ma, Bike Zhu, Yang Liu, Jingjing Pei, Richard Voyles, Xiaoyin Zheng
article en

Abstract

Vision-Language-Action (VLA) models represent a fundamental architectural shift in robotic learning, replacing modular perception-reasoning-control pipelines with unified frameworks that jointly optimize multimodal understanding and motor control. While large language models (LLMs) have enabled natural language grounding in robotics, the core challenge remains how to effectively fuse visual perception, linguistic reasoning, and continuous action generation within a single coherent architecture. This survey provides a systematic decomposition of modern VLA systems into three critical components, including multimodal perception encoders, cross-modal fusion mechanisms, and action decoders. We also critically evaluate the impact of design choices on generalization, sample efficiency, and task complexity. We distinguish two dominant architectural paradigms: end-to-end models that directly map observations to actions through learned representations, and hierarchical models that decompose tasks into explicit planning and execution stages. Through comparative analysis of their trade-offs in zero-shot generalization, interpretability, and long-horizon performance, we identify key open challenges in semantic grounding, spatial reasoning, and sim-to-real transfer that will determine the viability of VLAs for real-world deployment.

Robot learning.
The University of Texas at Arlington (US), Universidad Autónoma de Bucaramanga (CO), Dalian University of Technology (CN), Southern University of Science and Technology (CN)
Openalex Percentile: Top 4%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.