Modeling Mental Health Case-Mix for Quality Improvement—A Comparison of Statistical and AI Models

<b>Background/Objectives</b>: With the rising prevalence of mental health (MH) disorders, improving the effectiveness and quality of MH care has become increasingly imperative. To improve patient care outcomes, it is essential to accurately assess staffing needs and compare outcomes across providers to identify best practices. However, without a robust case-mix adjustment system that accounts for disease severity, efforts to measure staffing requirements and evaluate patient outcomes are of limited value. This study aimed to develop such a system by leveraging a large study population, more clinically homogeneous groups, and advanced modeling techniques. <b>Methods</b>: In this retrospective population-based study, over two million MH patients (n = 2,088,174) were grouped into 162 clinically homogeneous categories using Clinical Classifications Software Refined (CCSR) to enhance predictive accuracy. We evaluated the performance of four statistical models and four artificial intelligence (AI) models to identify the model that delivered the highest predictive power. <b>Results</b>: Among the statistical models, the Box-Cox regression yielded the highest predictive power (R<sup>2</sup> = 0.42; percent of variation explained [PVE] = 0.300). Among the AI models, CatBoost performed best (R<sup>2</sup> = 0.458; PVE = 0.311). While the AI models outperformed traditional statistical models, the improvements were modest. Sensitivity analyses confirmed the robustness of these models. <b>Conclusions</b>: Both the Box-Cox and CatBoost models demonstrated superior predictive performance compared to those reported in the literature. These findings suggest that a case-mix system based on either model can be used for risk adjustment to optimize staffing levels and benchmark patient outcomes for quality improvement.

Authors

Institutions

Publication Details

Journal
Healthcare
Published
2025-11-21
DOI
https://doi.org/10.3390/healthcare13233012
Primary Topic
Digital Mental Health Interventions
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Modeling Mental Health Case-Mix for Quality Improvement—A Comparison of Statistical and AI Models

Stacey Farmer, Tamára L. Box, Jian Gao, Ting Liu
Healthcare
Digital Mental Health Interventions
article

Modeling Mental Health Case-Mix for Quality Improvement—A Comparison of Statistical and AI Models

Stacey Farmer, Tamára L. Box, Jian Gao, Ting Liu
article en

Abstract

<b>Background/Objectives</b>: With the rising prevalence of mental health (MH) disorders, improving the effectiveness and quality of MH care has become increasingly imperative. To improve patient care outcomes, it is essential to accurately assess staffing needs and compare outcomes across providers to identify best practices. However, without a robust case-mix adjustment system that accounts for disease severity, efforts to measure staffing requirements and evaluate patient outcomes are of limited value. This study aimed to develop such a system by leveraging a large study population, more clinically homogeneous groups, and advanced modeling techniques. <b>Methods</b>: In this retrospective population-based study, over two million MH patients (n = 2,088,174) were grouped into 162 clinically homogeneous categories using Clinical Classifications Software Refined (CCSR) to enhance predictive accuracy. We evaluated the performance of four statistical models and four artificial intelligence (AI) models to identify the model that delivered the highest predictive power. <b>Results</b>: Among the statistical models, the Box-Cox regression yielded the highest predictive power (R<sup>2</sup> = 0.42; percent of variation explained [PVE] = 0.300). Among the AI models, CatBoost performed best (R<sup>2</sup> = 0.458; PVE = 0.311). While the AI models outperformed traditional statistical models, the improvements were modest. Sensitivity analyses confirmed the robustness of these models. <b>Conclusions</b>: Both the Box-Cox and CatBoost models demonstrated superior predictive performance compared to those reported in the literature. These findings suggest that a case-mix system based on either model can be used for risk adjustment to optimize staffing levels and benchmark patient outcomes for quality improvement.

HealthcareVol. 13(23)
Albany Stratton VA Medical Center Albany (US), Office of Patient Care Services (US), National Patient Safety Foundation (US), Siena College (US)
U.S. Department of Veterans Affairs, Office of Research and Development
Openalex Percentile: Top 60%
Digital Mental Health Interventions
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.