Evaluating the performance of the SORG machine learning algorithm for predicting discharge disposition in lumbar surgery patients

Protracted admissions following lumbar surgeries are rising, often stemming from inefficient identification of patients requiring nonhome discharge for rehabilitation. The SORG Orthopaedic Research Group at Harvard Medical School have developed a machine learning algorithm for predicting discharge following lumbar surgery. This study assessed its predictive performance on an independent tertiary centre patient cohort. Medical records were retrospectively reviewed for all elective adult lumbar disc degeneration or herniation surgeries performed between July 2017–2021 at a tertiary neurosurgical centre in the United Kingdom. Preoperative variables were collated and discharge destinations noted. Algorithm predictions were analysed using the concordance (c) statistic, Brier score and calibration plot. Positive and negative predictive values (PPV, NPV) were calculated, and a decision curve analysis (DCA) plotted. 251 subjects were included (48.2 % female, mean age 55.3 years). 2.8 % underwent nonhome discharge. Most had surgery at 1/2 spinal levels (98.4 %) and were functionally independent (84.5 %). Algorithm predictions yielded a 0.88 c-statistic and 0.029 Brier score. The algorithm was miscalibrated to the data (calibration plot slope 1.31 and intercept -1.12). At a 0.25 threshold for nonroutine discharge risk, the PPV was 0.19 and NPV 0.98. DCA revealed limited clinical utility. Algorithm predictive performance was mixed for this cohort, displaying strong discrimination but poor calibration and overestimation of nonroutine discharges. Differences in patient management practices and the low nonhome discharge rate may explain this. Larger validation studies across different healthcare systems, alongside geographically specific algorithm development, will improve predictive accuracy prior to clinical application.

Authors

Institutions

Publication Details

Journal
Seminars in Spine Surgery
Published
2024-09-10
DOI
https://doi.org/10.1016/j.semss.2024.101132
Primary Topic
Medical Imaging and Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluating the performance of the SORG machine learning algorithm for predicting discharge disposition in lumbar surgery patients

Emily R Bligh, Omar Salim, Calan Mathieson, Mohamed S Draz
Seminars in Spine Surgery
Medical Imaging and Analysis
article

Evaluating the performance of the SORG machine learning algorithm for predicting discharge disposition in lumbar surgery patients

Emily R Bligh, Omar Salim, Calan Mathieson, Mohamed S Draz
article en

Abstract

Protracted admissions following lumbar surgeries are rising, often stemming from inefficient identification of patients requiring nonhome discharge for rehabilitation. The SORG Orthopaedic Research Group at Harvard Medical School have developed a machine learning algorithm for predicting discharge following lumbar surgery. This study assessed its predictive performance on an independent tertiary centre patient cohort. Medical records were retrospectively reviewed for all elective adult lumbar disc degeneration or herniation surgeries performed between July 2017–2021 at a tertiary neurosurgical centre in the United Kingdom. Preoperative variables were collated and discharge destinations noted. Algorithm predictions were analysed using the concordance (c) statistic, Brier score and calibration plot. Positive and negative predictive values (PPV, NPV) were calculated, and a decision curve analysis (DCA) plotted. 251 subjects were included (48.2 % female, mean age 55.3 years). 2.8 % underwent nonhome discharge. Most had surgery at 1/2 spinal levels (98.4 %) and were functionally independent (84.5 %). Algorithm predictions yielded a 0.88 c-statistic and 0.029 Brier score. The algorithm was miscalibrated to the data (calibration plot slope 1.31 and intercept -1.12). At a 0.25 threshold for nonroutine discharge risk, the PPV was 0.19 and NPV 0.98. DCA revealed limited clinical utility. Algorithm predictive performance was mixed for this cohort, displaying strong discrimination but poor calibration and overestimation of nonroutine discharges. Differences in patient management practices and the low nonhome discharge rate may explain this. Larger validation studies across different healthcare systems, alongside geographically specific algorithm development, will improve predictive accuracy prior to clinical application.

Seminars in Spine SurgeryVol. 36(4)
Queen Elizabeth University Hospital (GB), University of Glasgow (GB)
Openalex Percentile: Top 86%
Medical Imaging and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.