Evaluation of ChatGPT’s Performance in Making-decision of Dialysis in Acute Kidney Injury

Objective: Artificial intelligence chatbots have begun to be widely used in medicine.We aimed to evaluate the performance of ChatGPT in identifying patients in need of dialysis.Method: A total of 100 patients who presented with acute kidney injury and were treated either with dialysis or without dialysis at the internal medicine clinic were retrospectively reviewed.Patient histories were created, consisting of demographic data, physical examination, and some laboratory tests.These patient histories were input into ChatGPT, and we requested a clinical evaluation along with recommendations categorizing them as low, medium, or high risk for dialysis treatment.The responses from ChatGPT were compared with the actual dialysis status of the patients.Additionally, ChatGPT responses were evaluated and scored by two nephrologists who were unaware of the dialysis status. Results:The sensitivity of ChatGPT in recommending patients' need for dialysis was calculated as 94%, 97%, and 97% for ChatGPT 1, 2, and 3 answers, respectively.Specificity for ChatGPT responses 1, 2, and 3 was calculated as 81%, 76%, and 78%, respectively (p<0.001).The mean clinical evaluation scores were 4.710.4and 4.670.4,and treatment recommendation scores were 4.450.7 and 4.390.7 for nephrologist 1 and nephrologist 2 (p=0.002)(p<0.001). Conclusion:ChatGPT can be used as a decision support tool to identify patients who may need dialysis.Nevertheless, healthcare professionals should remain part of the decision-making process at present.