Multi-National Validation of 5G-Enhanced Teleoperation with AR Interface and LSTM Prediction for Flexible Robotic Endoscopy with Sub-500ms Latency
Remote robotic-assisted teleoperation is vital for overcoming geographical barriers to flexible endoscopy. To address the requirements of both flexibility and high precision in telesurgery, an intuitive robotic-assisted system for remote control is implemented. The system utilizes 5G Customer Premises Equipment (CPE) devices, combined with the WireGuard protocol, to establish a secure, low-latency communication link. Through this connection, the remote surgeon controls the endoscope via a Unity-based interface enhanced with Augmented Reality (AR). Furthermore, a trained Long Short-Term Memory (LSTM) model predicts the tip’s position based on motor pulse inputs, improving control accuracy. The long-distance experiments conducted between Shenzhen, Shandong, Switzerland, Dalian, Ireland, and Hong Kong showed that the image transmission delay ranged from 50 to 200 ms, the control delay was approximately 100 ms, and the overall delay was about 300 to 400 ms. In addition, the LSTM model achieved a prediction error predominantly within 5 mm. These results validate a low-cost, high-precision remote endoscope control system with acceptable latency, underscoring its potential for practical telesurgery applications.
Authors
- Xiaoxiao Yang (ORCID: https://orcid.org/0000-0003-0290-2844)
- Xiuli Zuo (ORCID: https://orcid.org/0000-0001-9556-8771)
- Qingnan Jiang (ORCID: https://orcid.org/0000-0002-8891-8064)
- Hongliang Ren (ORCID: https://orcid.org/0000-0002-6488-1551)
- Huxin Gao (ORCID: https://orcid.org/0000-0002-8700-560X)
- Kun Luo (ORCID: https://orcid.org/0000-0001-5888-7175)
- Yupeng Wang
Institutions
- Shenzhen Institute of Information Technology (CN)
- Chinese University of Hong Kong (HK)
- Wuhan University (CN)
- Qilu Hospital of Shandong University (CN)
Publication Details
- Journal
- Procedia Computer Science
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1016/j.procs.2025.10.167
- Primary Topic
- Soft Robotics and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00