401 How do Classification Versus Regression Machine Learning Algorithms Predict 5-Year Minimum Clinically Important Differences in QOD Lumbar Spondylolisthesis Patients?
INTRODUCTION: Machine learning techniques able to parse high-dimensional clinical data are a promising avenue for optimized identification of ideal surgical candidates. The formulation of such medical prediction problems as classification or regression tasks can have significant effects on model performance. METHODS: Patients undergoing single-segment surgery were collected from the prospective Quality Outcomes Database Lumbar Spondylolisthesis dataset. Classification models were trained on 60-month achievement of minimum clinically important differences (MCID) for ODI, NRS-Back Pain, and NRS-Leg Pain. Equivalent regression models were trained on continuous variables of 60-month change in ODI, NRS-BP, and NRS-LP. Predicted values were converted to MCID achievement for model evaluation. All models were trained on an 80/20 split with 5-fold cross-validation, and Bayesian search was used for hyperparameter tuning. RESULTS: Our final cohort included 608 patients, with 487 completing 60-month follow-up. Of these patients, 304 (62.9%) reached MCID for ODI, 280 (66.2%) reached MCID for NRS-BP, and 322 (69.7%) reached MCID for NRS-LP. All models demonstrated highest predictive performance on MCID for NRS-LP tasks. The classification and regression models demonstrated largely equivalent AUC across prediction of MCID for NRS-LP (C:0.70±0.07to0.76±0.05, R:0.66±0.05to0.77±0.05), NRS-BP (C:0.63±0.06to0.72±0.07, R:0.67±0.07to0.69±0.07), and ODI (C:0.60±0.04to0.67±0.04, R:0.50±0.00to0.64±0.05). Notably, the MLP regressor outperformed all models on AUC for NRS-LP MCID prediction. For NRS-LP specifically, regression models consistently demonstrated higher accuracy, precision, F1, and recall metrics versus their classification counterparts. CONCLUSIONS: In a cohort undergoing surgery for Grade 1 degenerative lumbar spondylolisthesis, ML algorithms reliably predicted 5-year achievement of MCID across PROs. The equivalent and sometimes superior performance of regression models emphasizes the importance of thoughtful model selection and task formulation guided by clinical context.
Authors
- Erica F. Bisson (ORCID: https://orcid.org/0000-0002-8583-8544)
- Mark E. Shaffrey
- Jonathan R. Slotkin
- Michael Y. Wang (ORCID: https://orcid.org/0000-0002-8981-6385)
- Paul Park (ORCID: https://orcid.org/0000-0002-0375-396X)
- Steven D. Glassman (ORCID: https://orcid.org/0000-0002-5488-9357)
- Praveen V. Mummaneni (ORCID: https://orcid.org/0000-0001-5501-7262)
- Mohamad Bydon (ORCID: https://orcid.org/0000-0002-0543-396X)
- Mandeep S. Virk (ORCID: https://orcid.org/0000-0001-6294-2771)
- Christopher I. Shaffrey (ORCID: https://orcid.org/0000-0001-9760-8386)
- Anthony Asher (ORCID: https://orcid.org/0000-0002-7102-3627)
- Kevin T. Foley (ORCID: https://orcid.org/0000-0002-3111-3943)
- Eunice Yang (ORCID: https://orcid.org/0000-0002-9392-8910)
- Domagoj Coric (ORCID: https://orcid.org/0000-0001-8521-2691)
- Andrew K. Chan (ORCID: https://orcid.org/0000-0001-6953-0120)
- Dean Chou (ORCID: https://orcid.org/0000-0003-0310-8263)
- John J. Knightly (ORCID: https://orcid.org/0000-0003-0917-9265)
- Eric A. Potts (ORCID: https://orcid.org/0000-0003-4349-2327)
- Kai-Ming Fu
- Emily Schonfeld
- Regis W. Haid
Publication Details
- Journal
- Neurosurgery
- Published
- 2025-03-14
- DOI
- https://doi.org/10.1227/neu.0000000000003360_401
- Primary Topic
- Medical Imaging and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 0.00