Visually Robust, Safety-Blind: Vision-Language-Action Policies Ignore the Robot Next to Them

Vision-language-action (VLA) policies are evaluated alone on a table, yet deployments increasingly place several robots in one workspace. We add a second, non-contacting Franka arm B to LIBERO scenes and evaluate two VLAs of very different competence, SmolVLA (~70% success) and π0.5 (~98%). A benign moving neighbor leaves task success unchanged for both, but the victim comes within 3 cm of B in 44.5–46.5% of episodes and drives into B's volume in 24–27%; a physical-collision check confirms these intrusions are real contacts. A whole-arm control-barrier-function (CBF) filter on the victim removes near-misses but halves success (68→26% and 98.5→48%) because both robots stall in front of each other. A simple coordination rule in which B yields along an augmented-Lagrangian retreat restores 85% and 98% of that lost success with zero near-misses over 400 episodes. Optimized adversarial motions for B did not beat motion-matched benign motion on held-out seeds: the danger is not a clever adversary but an oblivious victim.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-04
DOI
https://doi.org/10.5281/zenodo.23956906
Primary Topic
Robot Manipulation and Learning
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Visually Robust, Safety-Blind: Vision-Language-Action Policies Ignore the Robot Next to Them

Atul Purohit, Manu Pareek
Zenodo (CERN European Organization for Nuclear Research)
Robot Manipulation and Learning
preprint

Visually Robust, Safety-Blind: Vision-Language-Action Policies Ignore the Robot Next to Them

Atul Purohit, Manu Pareek
preprint en

Abstract

Vision-language-action (VLA) policies are evaluated alone on a table, yet deployments increasingly place several robots in one workspace. We add a second, non-contacting Franka arm B to LIBERO scenes and evaluate two VLAs of very different competence, SmolVLA (~70% success) and π0.5 (~98%). A benign moving neighbor leaves task success unchanged for both, but the victim comes within 3 cm of B in 44.5–46.5% of episodes and drives into B's volume in 24–27%; a physical-collision check confirms these intrusions are real contacts. A whole-arm control-barrier-function (CBF) filter on the victim removes near-misses but halves success (68→26% and 98.5→48%) because both robots stall in front of each other. A simple coordination rule in which B yields along an augmented-Lagrangian retreat restores 85% and 98% of that lost success with zero near-misses over 400 episodes. Optimized adversarial motions for B did not beat motion-matched benign motion on held-out seeds: the danger is not a clever adversary but an oblivious victim.

Zenodo (CERN European Organization for Nuclear Research)
Georgia Institute of Technology (US)
Robot Manipulation and Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon