An Explainable AI-Enabled Clinical Decision-Support Framework for Urticaria Identification Using Structured Anamnesis Data: A Pilot Study
Although artificial intelligence has shown promising results in medical diagnosis, limited attention has been devoted to explainable frameworks for clinical decision support using structured anamnesis data whose potential clinical applications require prospective validation and workflow evaluation. In this retrospective proof-of-concept study, we propose an explainable AI framework for urticaria identification integrating machine learning models with post-hoc explainability techniques. The retrospective analytical cohort comprised 99 symptomatic adults from two participating primary-care group-practice settings in the province of Bari, Italy, including 50 patients with a final specialist-established diagnosis of urticaria and 49 symptomatic patients in whom urticaria was not confirmed. Gradient Boosting, Random Forest, and Logistic Regression were evaluated using repeated nested stratified cross-validation with ten repetitions, a five-fold outer loop for performance estimation, and a five-fold inner loop for hyperparameter optimization. All data-dependent preprocessing and hyperparameter tuning were performed exclusively within the corresponding training partitions. Logistic Regression achieved the highest mean AUC-ROC across repetitions (0.803 ± 0.024), whereas Random Forest achieved the highest mean recall (0.886 ± 0.016). The reported predictive performance reflects internal validation within the same retrospective analytical cohort. No independent external or temporal validation was performed. Explainability analyses provided insight into the clinical variables influencing model predictions. The explainability analyses characterize model-derived feature contributions but do not demonstrate improvements in clinician trust, patient understanding, shared decision-making, or clinical workflow outcomes. These potential applications require prospective evaluation involving clinicians and patients.
Authors
- Esra Hazar Sayar (ORCID: https://orcid.org/0000-0003-0338-1040)
- Giovanni Zambetta
- Roberto Caldelli (ORCID: https://orcid.org/0000-0003-3471-1196)
- Claudio Loconsole (ORCID: https://orcid.org/0000-0002-0662-6181)
- Daniela D’Auria (ORCID: https://orcid.org/0000-0002-6951-8508)
- Stefano Palazzo (ORCID: https://orcid.org/0009-0000-7274-5800)
Institutions
- Consorzio Nazionale Interuniversitario per le Telecomunicazioni (IT)
- Alanya University (TR)
- Mercatorum University (IT)
- Ospedale Generale Regionale Francesco Miulli (IT)
- Department of Public Health (MM)
- Alanya Alaaddin Keykubat Üniversitesi (TR)
Publication Details
- Journal
- Informatics
- Published
- 2026-11-13
- DOI
- https://doi.org/10.3390/informatics13110194
- Primary Topic
- Artificial Intelligence in Healthcare
- Type
- article
- Field-Weighted Citation Impact
- 0.00