Exploring the Potential of an AI Chatbot as a Supplementary Tool for Nutritional Prescription Hospital Discharge: A Preliminary Study

AI-based chatbots are increasingly used to automate clinical documentation, but their efficacy in generating specialized nutritional prescriptions for hospital discharge remains underexplored. This preliminary study evaluated the performance of a prominent AI chatbot in producing clinically valid nutritional guidelines. A specialist committee of registered dietitians selected 16 common medical and surgical pathologies. Standardized prompts were used to generate nutritional discharge guidelines from the chatbot. The same committee then evaluated the AI-generated texts for technical accuracy and content presentation on a 0-10 scale (approval score ≥ 7.0). Inter-rater reliability was assessed using the intraclass correlation coefficient (ICC) and Cohen's Kappa. Overall, 50% (8/16) of the AI-generated prescriptions met the predefined approval threshold. Performance was higher for medical pathologies (mean score: 7.1 ± 1.2) compared to surgical pathologies (6.6 ± 1.4), although this difference was not statistically significant (<i>p</i> > 0.05). Inter-rater reliability was substantial (ICC > 0.72; Kappa > 0.62). The findings indicate that AI chatbots hold promise as supplementary tools for drafting nutritional discharge summaries, potentially reducing administrative workload. However, their variable performance underscores the indispensable need for rigorous review and validation by qualified healthcare professionals before any clinical application.

Authors

Institutions

Publication Details

Journal
Scientifica
Published
2025-01-01
DOI
https://doi.org/10.1155/sci5/2632410
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Exploring the Potential of an AI Chatbot as a Supplementary Tool for Nutritional Prescription Hospital Discharge: A Preliminary Study

Paulo Adriano Schwingel, Bruno Bavaresco Gambassi, Dino Schwingel, Renato Augusto da Cruz Pereira et al.
Scientifica
Artificial Intelligence in Healthcare and Education
article

Exploring the Potential of an AI Chatbot as a Supplementary Tool for Nutritional Prescription Hospital Discharge: A Preliminary Study

Paulo Adriano Schwingel, Bruno Bavaresco Gambassi, Dino Schwingel, Renato Augusto da Cruz Pereira, Amanda Cristina Araújo Gomes, Raianne Rodrigues Lima, Fernanda Araújo Santos Saldanha
article en

Abstract

AI-based chatbots are increasingly used to automate clinical documentation, but their efficacy in generating specialized nutritional prescriptions for hospital discharge remains underexplored. This preliminary study evaluated the performance of a prominent AI chatbot in producing clinically valid nutritional guidelines. A specialist committee of registered dietitians selected 16 common medical and surgical pathologies. Standardized prompts were used to generate nutritional discharge guidelines from the chatbot. The same committee then evaluated the AI-generated texts for technical accuracy and content presentation on a 0-10 scale (approval score ≥ 7.0). Inter-rater reliability was assessed using the intraclass correlation coefficient (ICC) and Cohen's Kappa. Overall, 50% (8/16) of the AI-generated prescriptions met the predefined approval threshold. Performance was higher for medical pathologies (mean score: 7.1 ± 1.2) compared to surgical pathologies (6.6 ± 1.4), although this difference was not statistically significant (<i>p</i> > 0.05). Inter-rater reliability was substantial (ICC > 0.72; Kappa > 0.62). The findings indicate that AI chatbots hold promise as supplementary tools for drafting nutritional discharge summaries, potentially reducing administrative workload. However, their variable performance underscores the indispensable need for rigorous review and validation by qualified healthcare professionals before any clinical application.

ScientificaVol. 2025(1)
Universidade Ceuma (BR), Hospital Universitário da Universidade Federal do Maranhão (BR), Universidade Federal do Maranhão (BR), Universidade de Pernambuco (BR)
Conselho Nacional de Desenvolvimento Científico e Tecnológico, Fundação de Amparo à Ciência e Tecnologia do Estado de Pernambuco, Universidade Federal do Maranhão
Openalex Percentile: Top 77%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.