Perceptual Control for Assistive Robotics

People with transradial limb loss may benefit from assistive systems that combine muscle signals, gaze, and scene information while preserving user control. This work proposes Multimodal Affordance-based Shared Control (MASC), a framework that uses device-relative geometry to filter object–grasp candidates before confidence assessment and user confirmation. The proposed architecture integrates surface electromyography, eye tracking, and RGB-D vision with constraints on hand aperture, reach, and task feasibility. A synthetic benchmark comprising 100,000 evaluations assessed noisy intent ranking and geometric filtering. Hard filtering increased target-selection match from 29.32% for intent-only selection to 77.52%, while reducing infeasible selections from 66.12% to 8.50%. Adding a 5 mm feasibility margin further reduced infeasible selections to 3.38%, but increased abstention from 30.10% to 38.77% and reduced match to 73.56%. These findings illustrate a tradeoff between selection feasibility and abstention under simulated uncertainty. The benchmark evaluates the filtering component rather than the complete MASC system; it includes no human participants, measured muscle signals, or physical device trials. Future work will assess fault handling and compare matched multimodal controllers with and without feasibility filtering before human evaluation.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-26
DOI
https://doi.org/10.5281/zenodo.23659431
Primary Topic
Prosthetics and Rehabilitation Robotics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Perceptual Control for Assistive Robotics

Vaishali Jha
Zenodo (CERN European Organization for Nuclear Research)
Prosthetics and Rehabilitation Robotics
article

Perceptual Control for Assistive Robotics

Vaishali Jha
article en

Abstract

People with transradial limb loss may benefit from assistive systems that combine muscle signals, gaze, and scene information while preserving user control. This work proposes Multimodal Affordance-based Shared Control (MASC), a framework that uses device-relative geometry to filter object–grasp candidates before confidence assessment and user confirmation. The proposed architecture integrates surface electromyography, eye tracking, and RGB-D vision with constraints on hand aperture, reach, and task feasibility. A synthetic benchmark comprising 100,000 evaluations assessed noisy intent ranking and geometric filtering. Hard filtering increased target-selection match from 29.32% for intent-only selection to 77.52%, while reducing infeasible selections from 66.12% to 8.50%. Adding a 5 mm feasibility margin further reduced infeasible selections to 3.38%, but increased abstention from 30.10% to 38.77% and reduced match to 73.56%. These findings illustrate a tradeoff between selection feasibility and abstention under simulated uncertainty. The benchmark evaluates the filtering component rather than the complete MASC system; it includes no human participants, measured muscle signals, or physical device trials. Future work will assess fault handling and compare matched multimodal controllers with and without feasibility filtering before human evaluation.

Zenodo (CERN European Organization for Nuclear Research)
University of California, Berkeley (US)
Openalex Percentile: Top 24%
Prosthetics and Rehabilitation Robotics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon