Comprehensive protocol for mixed reality visualization and navigation using 3D Slicer

Advancements in mixed reality (MxR) technology have significantly enhanced neurosurgical navigation by improving visualization, spatial accuracy, and surgical outcomes. MxR navigation (MRN) provides a cost-effective and intuitive alternative to conventional navigation systems, enabling stable spatial mapping and independent navigation. Despite this potential, implementing MRN is complex, creating a need for structured workflows and rigorous accuracy assessments. To address this gap, this protocol presents a structured, modular, and reproducible lab protocol based on the open-source platform 3D Slicer, enabling effective implementation and evaluation of developed MRN systems in neurosurgical contexts. This protocol clearly defines sequential steps, required inputs, and expected outputs for both visualization-oriented and navigation-oriented workflows. It encompasses preprocessing (anonymization, quality checks, multimodal image fusion), semi-automatic segmentation of anatomical structures (e.g., lesions, vessels, fiber tracts), and the generation of precise 3D surface models (STL or OBJ formats). For navigation scenarios, the protocol includes parameterization of fiducial landmarks, anatomical surfaces, and laser projections for precise virtual-to-physical registration. Accuracy and performance validation are rigorously assessed using virtual and physical static digital twins, generating quantitative displacement analyses and intuitive visualizations directly interpretable in clinical and research environments. The modular design and exclusive reliance on open-source software ensure reproducibility, flexibility, and broad interdisciplinary accessibility, benefiting users from diverse backgrounds with basic knowledge in anatomy, neurosurgery, and computer graphics.

Authors

Institutions

Publication Details

Journal
PLoS ONE
Published
2026-03-31
DOI
https://doi.org/10.1371/journal.pone.0343997
Primary Topic
Augmented Reality Applications
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comprehensive protocol for mixed reality visualization and navigation using 3D Slicer

Ziyu Qi, Miriam H. A. Bopp, Christopher Nimsky
PLoS ONE
Augmented Reality Applications
article

Comprehensive protocol for mixed reality visualization and navigation using 3D Slicer

Ziyu Qi, Miriam H. A. Bopp, Christopher Nimsky
article en

Abstract

Advancements in mixed reality (MxR) technology have significantly enhanced neurosurgical navigation by improving visualization, spatial accuracy, and surgical outcomes. MxR navigation (MRN) provides a cost-effective and intuitive alternative to conventional navigation systems, enabling stable spatial mapping and independent navigation. Despite this potential, implementing MRN is complex, creating a need for structured workflows and rigorous accuracy assessments. To address this gap, this protocol presents a structured, modular, and reproducible lab protocol based on the open-source platform 3D Slicer, enabling effective implementation and evaluation of developed MRN systems in neurosurgical contexts. This protocol clearly defines sequential steps, required inputs, and expected outputs for both visualization-oriented and navigation-oriented workflows. It encompasses preprocessing (anonymization, quality checks, multimodal image fusion), semi-automatic segmentation of anatomical structures (e.g., lesions, vessels, fiber tracts), and the generation of precise 3D surface models (STL or OBJ formats). For navigation scenarios, the protocol includes parameterization of fiducial landmarks, anatomical surfaces, and laser projections for precise virtual-to-physical registration. Accuracy and performance validation are rigorously assessed using virtual and physical static digital twins, generating quantitative displacement analyses and intuitive visualizations directly interpretable in clinical and research environments. The modular design and exclusive reliance on open-source software ensure reproducibility, flexibility, and broad interdisciplinary accessibility, benefiting users from diverse backgrounds with basic knowledge in anatomy, neurosurgery, and computer graphics.

PLoS ONEVol. 21(3)
Philipps University of Marburg (DE), Center for Behavioral Brain Sciences (DE)
Philipps-Universität Marburg
Openalex Percentile: Top 40%
Augmented Reality Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.