Digitizing Diagnoses: Distinguishing Infantile Hemangiomas From Other Vascular Anomalies

This off-the-shelf publicly available GPT (75%) was less accurate than a previously published well-trained AI that achieved higher accuracy (~92%). GPT's F1 score of 0.742 indicates moderate balance between precision and sensitivity, and an AUC calculation of 0.80 indicates a potential role for GPT as a clinical assistant in primary care settings. An untuned commercial GPT does not yet outperform pediatricians despite studies of well-trained AI. This study provides variables impacting GPT accuracy, serving as a foundation for future research.