Vision‐Based Handover and Organization of Robotic Scrub Nurse for Seamless Surgical Flow
Scrub nurses are essential for managing surgical instruments and ensuring seamless surgical flow; however, a global shortage has become increasingly severe. Robotic scrub nurse (RSN) systems have been proposed to mitigate this issue by supporting tasks such as surgical instrument handovers. Nevertheless, existing RSN methods rarely consider the natural manner in which human scrub nurses (HSNs) transfer instruments, including surgeons’ grasping techniques and the orientation of instruments, which may disrupt workflow. To address this limitation, we introduce a pose estimation‐based RSN (PERSN) that integrates vision‐based perception to estimate the surgeon's hand position, orientation, and grasping state, as well as the constraint‐based 6D pose of surgical instruments. A user study involving 17 experienced surgeons evaluated PERSN against both a HSN and the predefined‐location handover (PLH) method. Results showed high success rates in handover and organization. Instruments delivered by PERSN were immediately usable in significantly more cases than with PLH, directly supporting uninterrupted surgical flow. NASA‐TLX analysis indicated that PERSN reduced physical demand compared with PLH, while Van der Laan's technology acceptance scores revealed significantly higher ratings for usefulness and satisfaction. These findings demonstrate the potential of PERSN to reduce surgeons’ physical burden and to enhance efficiency in next‐generation surgical procedures.
Authors
- Geunwu Gimm (ORCID: https://orcid.org/0000-0002-7414-4125)
- Seongjoon Kang (ORCID: https://orcid.org/0009-0007-6855-0948)
- Youho Myong (ORCID: https://orcid.org/0000-0002-2469-839X)
- Jae Woo Shim (ORCID: https://orcid.org/0000-0002-3940-1309)
- Jong Hyeon Lee
- Changhoon Baek (ORCID: https://orcid.org/0000-0003-2714-076X)
- Sungwan Kim (ORCID: https://orcid.org/0000-0002-9318-849X)
- Seung Jae Choi
- Minwoo Cho (ORCID: https://orcid.org/0000-0003-2242-4747)
- Yoon Jae Kim
Institutions
- Seoul National University (KR)
- New Generation University College (ET)
- Seoul National University Hospital (KR)
- National Medical Center (KR)
Publication Details
- Journal
- Advanced Intelligent Systems
- Published
- 2026-04-22
- DOI
- https://doi.org/10.1002/aisy.202501328
- Primary Topic
- Surgical Simulation and Training
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Seoul National University Hospital