Feasibility of Augmented Reality-Guided Robotic Ultrasound with Cone-Beam CT Integration for Spine Procedures
Needle placement in spine interventions is critical for effective pain management, yet it depends on reliable identification of anatomical landmarks and careful trajectory planning. Conventional imaging guidance often relies on both computed tomography (CT) and X-ray fluoroscopy, exposing patients and staff to high doses of radiation while providing limited real-time 3D feedback. The choice of visualization may also affect operator performance and cognitive workload. We present an optical see-through augmented reality (OST-AR)–guided robotic system for spine procedures that provides in situ visualization of spinal structures to support needle trajectory planning. We integrate a cone-beam CT (CBCT)-derived 3D spine model, which is co-registered with live ultrasound, enabling users to combine global anatomical context with local, real-time imaging. We evaluated the system in a phantom user study involving two representative spine procedures: facet joint injection and lumbar puncture. Sixteen participants performed insertions under two visualization conditions: conventional screen vs. AR. Results show that AR significantly reduces execution time and across-task placement error, while also improving usability, trust, and spatial understanding, and lowering cognitive workload. These findings demonstrate the feasibility of AR-guided robotic ultrasound for spine interventions, highlighting its potential to enhance accuracy, efficiency, and user experience in image-guided procedures.
Authors
- Ulrich Eck (ORCID: https://orcid.org/0000-0002-5322-4724)
- Nassir Navab (ORCID: https://orcid.org/0000-0002-6032-5611)
- Yordanka Velikova
- Miruna-Alexandra Gafencu (ORCID: https://orcid.org/0009-0003-7546-3683)
- Felix Pabst (ORCID: https://orcid.org/0009-0004-7853-0834)
- Yuan Bi
- Tianyu Song
- Feng Li (ORCID: https://orcid.org/0000-0003-2717-8274)
Institutions
- Technical University of Munich (DE)
Publication Details
- Published
- 2026-11-17
- DOI
- https://doi.org/10.22541/authorea.15012339/v1
- Citations
- 1
- Primary Topic
- Augmented Reality Applications
- Type
- preprint
Funders
- Bayerische Forschungsstiftung