A Bioinspired Virtual Reality Toolkit for Robot-Assisted Medical Application: BioVRbot

The increasingly pervasive usage of robotic surgery not only calls for advances in clinical application but also implies high availability for preliminary medical education using virtual reality. Virtual reality is currently upgrading medical education by presenting complicated medical information in an immersive and interactive way. A system that allows multiple users to observe and operate via simulated surgical platforms using wearable devices has become an efficient solution for teaching where a real surgical platform is not available. This article developed a bioinspired virtual reality toolkit (BioVRbot) for education and training in robot-assisted minimally invasive surgery. It allows multiple users to manipulate the robots working on cooperative virtual surgery using bioinspired control. The virtual reality scenario is implemented using unity and can be observed with independent virtual reality headsets. A MATLAB server is designed to manage robot motion planning of incremental teleoperation compliance with the remote center of motion constraints. Wearable sensorized gloves are adopted for continuous control of the tooltip and the gripper. Finally, the practical use of the developed surgical virtual system is demonstrated with cooperative operation tasks. It could be further spread into the classroom for preliminary education of robot-assisted surgery for early-stage medical students.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Human-Machine Systems
Published
2024-10-09
DOI
https://doi.org/10.1109/thms.2024.3462416
Citations
17
Primary Topic
Scientific Computing and Data Management
Type
article
Field-Weighted Citation Impact
17.86

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Bioinspired Virtual Reality Toolkit for Robot-Assisted Medical Application: BioVRbot

Francesco Jamal Sheiban, Wen Qi, Samer Alfayad, Salih Ertug Ovur et al.
17 citations
IEEE Transactions on Human-Machine Systems
Scientific Computing and Data Management
17.86
article

A Bioinspired Virtual Reality Toolkit for Robot-Assisted Medical Application: BioVRbot

Francesco Jamal Sheiban, Wen Qi, Samer Alfayad, Salih Ertug Ovur, Hang Su
article en
17 citations

Abstract

The increasingly pervasive usage of robotic surgery not only calls for advances in clinical application but also implies high availability for preliminary medical education using virtual reality. Virtual reality is currently upgrading medical education by presenting complicated medical information in an immersive and interactive way. A system that allows multiple users to observe and operate via simulated surgical platforms using wearable devices has become an efficient solution for teaching where a real surgical platform is not available. This article developed a bioinspired virtual reality toolkit (BioVRbot) for education and training in robot-assisted minimally invasive surgery. It allows multiple users to manipulate the robots working on cooperative virtual surgery using bioinspired control. The virtual reality scenario is implemented using unity and can be observed with independent virtual reality headsets. A MATLAB server is designed to manage robot motion planning of incremental teleoperation compliance with the remote center of motion constraints. Wearable sensorized gloves are adopted for continuous control of the tooltip and the gripper. Finally, the practical use of the developed surgical virtual system is demonstrated with cooperative operation tasks. It could be further spread into the classroom for preliminary education of robot-assisted surgery for early-stage medical students.

IEEE Transactions on Human-Machine SystemsVol. 54(6)
Université Paris-Saclay (FR), Informatique, BioInformatique, Systèmes Complexes (FR), Imperial College London (GB), South China University of Technology (CN), Politecnico di Milano (IT)
National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities
Openalex Percentile: Top 1%
Scientific Computing and Data Management
17.86
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.