Beyond Time-Based Billing: An AI-Enabled Complexity Model for Secure Message Reimbursement
<b>Background</b>: Current telehealth reimbursement guidelines, based primarily on evaluation and management duration, inadequately capture the true clinical complexity and cognitive effort involved in provider responses to secure patient messages. There is a critical need for reimbursement frameworks that reflect the nuanced reality of clinical care delivered through asynchronous telehealth messaging. <b>Materials and Methods</b>: We analyzed 149,499 secure messages (2023-2024) from a large health system. Given the impracticality of manually annotating all threads, we used supervised pseudo-labeling informed by rigorous annotation guidelines (interrater reliability: Cohen's κ = 0.816) applied to a representative subset. Clinical complexity was quantified through features of providers' electronic health records engagement (Domain Engagement [DE]) and message linguistic complexity (Cognitive Judgment [CJ]). A gradient boosting classifier leveraging these complexity-based features was developed and validated via stratified cross-validation, temporal validation, and leave-one-provider-out testing. Interpretability was assessed using permutation importance and Shapley Additive Explanations values. <b>Results</b>: The complexity-based model achieved strong predictive performance (area under the curve [AUC] ∼0.82), substantially outperforming a time-based baseline (AUC ∼0.57). Key predictors included unique medical concepts, breadth of clinical content, and emotional urgency. Traditional metrics like message length and duration were poor predictors. Billable threads showed significantly higher medical density (∼55 vs. ∼33 concepts) and emotional intensity (∼0.6 vs. ∼0.3), supporting DE and CJ validity. <b>Discussion</b>: Complexity-based features more accurately captured providers' cognitive effort than elapsed time alone, consistent with Cognitive Load, Complexity, and Sensemaking theories. <b>Conclusion</b>: This AI-enabled complexity-based model provides a practical, accurate, and explainable foundation for telehealth billing reform, facilitating fairer provider reimbursement and improved telehealth sustainability.
Authors
- Umberto Tachinardi (ORCID: https://orcid.org/0000-0001-6205-3800)
- Eric J. Warm (ORCID: https://orcid.org/0000-0002-6088-2434)
- Dong‐Gil Ko (ORCID: https://orcid.org/0000-0002-1967-0333)
- Farrah Rahim
- Samantha A. Schoenl
Institutions
- Cincinnati Children's Hospital Medical Center (US)
- Cincinnati Health Department (US)
- University of Cincinnati Medical Center (US)
Publication Details
- Journal
- Telemedicine Journal and e-Health
- Published
- 2025-09-23
- DOI
- https://doi.org/10.1177/15305627251377376
- Primary Topic
- Electronic Health Records Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00