Prediction of Rhinologic Surgery Within 90 Days Using Item‐Level SNOT‐22 Responses: A Multisite Machine Learning Study of 35,170 Patients

ABSTRACT Background Optimizing access to cost‐effective care in capacity‐constrained health systems is a contemporary imperative. We evaluated whether machine learning (ML) models using patient‐reported data could optimize access for patients requiring surgical care in rhinology clinics, without need for CT imaging. The outcome was defined as any rhinologic surgery within 90 days of initial evaluation. Methods A de‐identified electronic dataset from patients seen at five distinct sites within an integrated healthcare system between 2018 and 2025 was used to train models. Demographic data and 22‐item Sinonasal Outcome Test (SNOT‐22) responses were studied. Models were trained using stratified 5‐fold cross‐validation with an 80% development cohort and validated in a 20% held‐out validation cohort. Hyperparameters were optimized with Optuna. The primary outcome was performance of any rhinologic surgical intervention within 90 days of initial SNOT‐22. Results Data from 35,170 patients were evaluated. Item‐level responses outperformed use of total SNOT‐22 score in the models. Among models, XGBoost demonstrated best discrimination with AUC of 0.70 (95% CI, 0.69–0.71), outperforming logistic regression (0.66), random forest (0.63), and TabNet (0.66) (all p < 0.001). At optimal threshold, XGBoost achieved 66% sensitivity, 64% specificity, 28% PPV, and 90% NPV. Top predictors for surgery were age, nasal blockage, facial pain or pressure, and decreased sense of smell or taste. Validation on the held‐out cohort remained stable (AUC 0.70), with strong discrimination across sites despite surgical rates ranging from 11.5% to 27.4%. Conclusions Demographics and item‐level SNOT‐22 responses were successful in developing an ML model that demonstrated moderate discrimination and high NPV (90%) for performance of surgery within next 90 days. ML models balanced with human oversight may accelerate triage and optimize surgical yield for rhinology clinics.

Authors

Institutions

Publication Details

Journal
International Forum of Allergy & Rhinology
Published
2026-09-10
DOI
https://doi.org/10.1002/alr.70273
Primary Topic
Nasal Surgery and Airway Studies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Prediction of Rhinologic Surgery Within 90 Days Using Item‐Level SNOT‐22 Responses: A Multisite Machine Learning Study of 35,170 Patients

Devyani Lal, Amar Miglani, Nitish Kumar, Shrinath Patel et al.
International Forum of Allergy & Rhinology
Nasal Surgery and Airway Studies
article

Prediction of Rhinologic Surgery Within 90 Days Using Item‐Level SNOT‐22 Responses: A Multisite Machine Learning Study of 35,170 Patients

Devyani Lal, Amar Miglani, Nitish Kumar, Shrinath Patel, Michael Marino, Michael Sramek
article en

Abstract

ABSTRACT Background Optimizing access to cost‐effective care in capacity‐constrained health systems is a contemporary imperative. We evaluated whether machine learning (ML) models using patient‐reported data could optimize access for patients requiring surgical care in rhinology clinics, without need for CT imaging. The outcome was defined as any rhinologic surgery within 90 days of initial evaluation. Methods A de‐identified electronic dataset from patients seen at five distinct sites within an integrated healthcare system between 2018 and 2025 was used to train models. Demographic data and 22‐item Sinonasal Outcome Test (SNOT‐22) responses were studied. Models were trained using stratified 5‐fold cross‐validation with an 80% development cohort and validated in a 20% held‐out validation cohort. Hyperparameters were optimized with Optuna. The primary outcome was performance of any rhinologic surgical intervention within 90 days of initial SNOT‐22. Results Data from 35,170 patients were evaluated. Item‐level responses outperformed use of total SNOT‐22 score in the models. Among models, XGBoost demonstrated best discrimination with AUC of 0.70 (95% CI, 0.69–0.71), outperforming logistic regression (0.66), random forest (0.63), and TabNet (0.66) (all p < 0.001). At optimal threshold, XGBoost achieved 66% sensitivity, 64% specificity, 28% PPV, and 90% NPV. Top predictors for surgery were age, nasal blockage, facial pain or pressure, and decreased sense of smell or taste. Validation on the held‐out cohort remained stable (AUC 0.70), with strong discrimination across sites despite surgical rates ranging from 11.5% to 27.4%. Conclusions Demographics and item‐level SNOT‐22 responses were successful in developing an ML model that demonstrated moderate discrimination and high NPV (90%) for performance of surgery within next 90 days. ML models balanced with human oversight may accelerate triage and optimize surgical yield for rhinology clinics.

International Forum of Allergy & Rhinology
Mayo Clinic in Arizona (US), Mayo Clinic Hospital (US)
Reduced inequalities
Openalex Percentile: Top 8%
Nasal Surgery and Airway Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.