Automatic spine exposure segmentation in stereovision imaging using SAM 2 for driving image updating pipeline for preoperative to intraoperative registration in open spine procedures

<strong>Background</strong>: Surgical navigation is growing to become the standard of care in spine surgery. However, spinal motion occurring from either preoperative-to-intraoperative patient positioning or from movement after intraoperative registration can degrade the navigation accuracy. A level-wise, stereovision-based image updating pipeline has been developed to account for this motion registering each spinal level of preoperative imaging to the intraoperative stereovision surface. <strong>Objective</strong>: We aim to automate the detection of the spine exposure in a series of stereovision images captured during an open spine procedure in order to remove current user-based, manual methods. These images serve as input to the imageupdating pipeline. The Segment Anything Model 2 (SAM2) is leveraged for the automation of this detection. <strong>Methods</strong>: We obtained preoperative CT, intraoperative CT, and tracked stereovision images of a cadaver swine’s spine. SAM2 automatically segments the exposure of the spine in an initial stereovision image and propagates the exposure mask across subsequent images. Information from depth maps are used to refine the masks further creating an automatic mask generation scheme that informs the input to a level-wise registration pipeline. Results: The automated masks perform comparably to a manually segmented mask for level-wise registration accuracy. For levels with sufficient exposure and correspondence, the SAM2 based masks and the manual segmentation masks drive the pipeline to a 2.06 mm +/- 0.49 mm and 1.98 mm +/- 0.95 mm registration accuracy respectively. <strong>Conclusions</strong>: The automated method of spine exposure detection in stereovision aids to remove user dependance from the input to our level-wise registration pipeline in open spine surgery. SAM2 provides good zero-shot inference for stereovision images of the exposed spine surgical site.

Authors

Institutions

Publication Details

Published
2025-04-07
DOI
https://doi.org/10.1117/12.3047443
Primary Topic
Medical Imaging and Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Automatic spine exposure segmentation in stereovision imaging using SAM 2 for driving image updating pipeline for preoperative to intraoperative registration in open spine procedures

Keith D. Paulsen, Haley E. Stoner, William R. Warner, Xiaoyao Fan et al.
Medical Imaging and Analysis
article

Automatic spine exposure segmentation in stereovision imaging using SAM 2 for driving image updating pipeline for preoperative to intraoperative registration in open spine procedures

Keith D. Paulsen, Haley E. Stoner, William R. Warner, Xiaoyao Fan, Ryan B. Duke, Linton T. Evans, Songbai Ji, Sohail K. Mirza, Chengpei Li
article en

Abstract

<strong>Background</strong>: Surgical navigation is growing to become the standard of care in spine surgery. However, spinal motion occurring from either preoperative-to-intraoperative patient positioning or from movement after intraoperative registration can degrade the navigation accuracy. A level-wise, stereovision-based image updating pipeline has been developed to account for this motion registering each spinal level of preoperative imaging to the intraoperative stereovision surface. <strong>Objective</strong>: We aim to automate the detection of the spine exposure in a series of stereovision images captured during an open spine procedure in order to remove current user-based, manual methods. These images serve as input to the imageupdating pipeline. The Segment Anything Model 2 (SAM2) is leveraged for the automation of this detection. <strong>Methods</strong>: We obtained preoperative CT, intraoperative CT, and tracked stereovision images of a cadaver swine’s spine. SAM2 automatically segments the exposure of the spine in an initial stereovision image and propagates the exposure mask across subsequent images. Information from depth maps are used to refine the masks further creating an automatic mask generation scheme that informs the input to a level-wise registration pipeline. Results: The automated masks perform comparably to a manually segmented mask for level-wise registration accuracy. For levels with sufficient exposure and correspondence, the SAM2 based masks and the manual segmentation masks drive the pipeline to a 2.06 mm +/- 0.49 mm and 1.98 mm +/- 0.95 mm registration accuracy respectively. <strong>Conclusions</strong>: The automated method of spine exposure detection in stereovision aids to remove user dependance from the input to our level-wise registration pipeline in open spine surgery. SAM2 provides good zero-shot inference for stereovision images of the exposed spine surgical site.

Worcester Polytechnic Institute (US), Dartmouth College (US), Dartmouth–Hitchcock Medical Center (US)
Openalex Percentile: Top 93%
Medical Imaging and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.