Exploring the Potential of an AI Chatbot as a Supplementary Tool for Nutritional Prescription Hospital Discharge: A Preliminary Study
AI-based chatbots are increasingly used to automate clinical documentation, but their efficacy in generating specialized nutritional prescriptions for hospital discharge remains underexplored. This preliminary study evaluated the performance of a prominent AI chatbot in producing clinically valid nutritional guidelines. A specialist committee of registered dietitians selected 16 common medical and surgical pathologies. Standardized prompts were used to generate nutritional discharge guidelines from the chatbot. The same committee then evaluated the AI-generated texts for technical accuracy and content presentation on a 0-10 scale (approval score ≥ 7.0). Inter-rater reliability was assessed using the intraclass correlation coefficient (ICC) and Cohen's Kappa. Overall, 50% (8/16) of the AI-generated prescriptions met the predefined approval threshold. Performance was higher for medical pathologies (mean score: 7.1 ± 1.2) compared to surgical pathologies (6.6 ± 1.4), although this difference was not statistically significant (<i>p</i> > 0.05). Inter-rater reliability was substantial (ICC > 0.72; Kappa > 0.62). The findings indicate that AI chatbots hold promise as supplementary tools for drafting nutritional discharge summaries, potentially reducing administrative workload. However, their variable performance underscores the indispensable need for rigorous review and validation by qualified healthcare professionals before any clinical application.
Authors
- Paulo Adriano Schwingel (ORCID: https://orcid.org/0000-0002-2935-3403)
- Bruno Bavaresco Gambassi (ORCID: https://orcid.org/0000-0003-3852-0602)
- Dino Schwingel (ORCID: https://orcid.org/0009-0006-9939-6499)
- Renato Augusto da Cruz Pereira (ORCID: https://orcid.org/0009-0009-9398-3002)
- Amanda Cristina Araújo Gomes (ORCID: https://orcid.org/0000-0002-8001-9590)
- Raianne Rodrigues Lima (ORCID: https://orcid.org/0000-0002-6656-5886)
- Fernanda Araújo Santos Saldanha (ORCID: https://orcid.org/0000-0002-6109-582X)
Institutions
- Universidade Ceuma (BR)
- Hospital Universitário da Universidade Federal do Maranhão (BR)
- Universidade Federal do Maranhão (BR)
- Universidade de Pernambuco (BR)
Publication Details
- Journal
- Scientifica
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1155/sci5/2632410
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Conselho Nacional de Desenvolvimento Científico e Tecnológico
- Fundação de Amparo à Ciência e Tecnologia do Estado de Pernambuco
- Universidade Federal do Maranhão