CoRA-VTLA: Contact-Guided Attention and Queryable Response Memory for Tactile Post-Training
In precision manipulation, small errors in alignment or force can cause jamming or deformation, making contact feedback essential for adapting pretrained vision-language-action (VLA) models to these tasks. A single tactile observation leaves the response to recent actions ambiguous. Direct tactile fusion during post-training can also disperse the action expert's visual attention and reduce the share it allocates to contact regions. To address these challenges, CoRA-VTLA augments pretrained VLAs with lightweight tactile modules. A queryable action-response memory retrieves recent contact responses so that the action expert can combine them with immediate tactile feedback. Contact-guided gaze supervision concentrates the visual attention of the tactile semantic token on image regions corresponding to fingertip contact. CoRA-VTLA achieves 73.33% mean success across three MuJoCo tasks, compared with 50% for direct tactile fusion with the same sensor inputs. It also achieves 67% success on an optical-tactile task from the public UniVTAC benchmark and 66.7% mean success across three real-robot tasks. These results show that tactile post-training helps pretrained VLAs adjust to changing contact.
Authors
- Rui Song (ORCID: https://orcid.org/0000-0002-8695-1522)
- Chengye Song
- Hongzhou Wang (ORCID: https://orcid.org/0000-0003-3877-6798)
- Shengqi Wang (ORCID: https://orcid.org/0009-0004-2786-4623)
- Xueyang Guo (ORCID: https://orcid.org/0009-0004-9591-1030)
- Jiawei Zhang
- Yang Liu
Publication Details
- Journal
- arXiv (Cornell University)
- Published
- 2026-11-18
- DOI
- https://doi.org/10.48550/arxiv.2611.23963
- Primary Topic
- Robot Manipulation and Learning
- Type
- preprint