Endomersion: An Immersive Remote Guidance and Feedback System for Robot-Assisted Minimally Invasive Surgery
The current practice of surgical telementoring involves remote experts providing guidance via telephone or video conferences. Especially in minimally invasive surgery (MIS), this greatly limits their insight into the procedure and inhibits effective deictic referencing. To address this, we present Endomersion, an immersive remote guidance and feedback system that allows verbal and non-verbal communication through audio chat, pointing and telestration, enables remote control of the endoscope camera, and offers an immersive 3D workspace supporting remote expert’s understanding of the on-site operation. The system was developed with feedback from surgeons and tested in actual operating room settings. In this demonstration, users take over the role of the remote expert, communicating with the on-site surgeon and remotely controlling the endoscopic camera attached to a robot arm.
Authors
- Stefanie Speidel (ORCID: https://orcid.org/0000-0002-4590-1908)
- Jürgen Weitz (ORCID: https://orcid.org/0000-0002-5760-6391)
- Martin Wagner (ORCID: https://orcid.org/0000-0002-9831-9110)
- Jens Krzywinski (ORCID: https://orcid.org/0000-0003-2862-9196)
- Sebastian Bodenstedt (ORCID: https://orcid.org/0000-0002-2203-9729)
- Raimund Dachselt (ORCID: https://orcid.org/0000-0002-2176-876X)
- Rayan Younis (ORCID: https://orcid.org/0000-0002-7558-8043)
- Mats Ole Ellenberg (ORCID: https://orcid.org/0000-0002-0354-1537)
- Alejandro Rodríguez (ORCID: https://orcid.org/0000-0003-4781-6368)
- Katja Krug (ORCID: https://orcid.org/0000-0003-4800-6287)
- Yichen Fan (ORCID: https://orcid.org/0009-0001-1210-4080)
- Gregor Just
Institutions
- National Center for Tumor Diseases (DE)
- University Hospital Carl Gustav Carus (DE)
- Technische Universität Dresden (DE)
Publication Details
- Published
- 2025-03-08
- DOI
- https://doi.org/10.1109/vrw66409.2025.00450
- Citations
- 1
- Primary Topic
- Augmented Reality Applications
- Type
- article
- Field-Weighted Citation Impact
- 1.28
Funders
- Ministry of Education
- Deutsche Forschungsgemeinschaft