Using a Large Language Model Chatbot for Allergen Avoidance Counseling in Contact Dermatitis: Quantitative Evaluation Study
Background: AI is increasingly impacting health care. Large language models (LLMs), such as ChatGPT, have shown potential in supporting clinical decision-making. However, their application in dermatology, particularly in allergen avoidance counseling for contact dermatitis, remains underexplored. Objective: This study aimed to demonstrate a potential use case for LLM responses in recommending allergen-free products for the management of contact allergies. Methods: A total of 30 allergen groups included in the international standard patch test were assessed. ChatGPT (GPT-4) was used in this study from September 2023 to January 2024. For each allergen, ChatGPT was tasked with recommending 5 allergen-free products using 3 question formats of varying complexity. Responses were included if they specified a product and were manually classified by dermatologists into 5 categories: valid, invalid, cross-reaction, unknown, and unresponsive. Results: ChatGPT provided 79.20% (1782/2250) valid responses, with 1.78% (40/2250) classified as invalid, 2% (45/2550) classified as cross-reactions, 8.67% (195/2250) classified as unknown, and 8.36% (188/2250) classified as unresponsive. The simplest question format yielded the highest proportion of valid recommendations (640/750, 85.33%). ChatGPT performed best when recommending cosmetics (1233/1365, 90.33%) and medications (198/240, 82.5%). However, lower validity rates were observed for recommendations involving certain sensitive allergens, including fragrance mixes and para-phenylenediamine (PPD), with frequent cross-reactive recommendations related to Peru balsam. Conclusions: The version of ChatGPT evaluated in this study showed potential as a supplementary tool for allergen avoidance counseling. However, its recommendations require verification and should not replace clinician guidance or established allergen avoidance resources.
Authors
- Poohglin Tresukosol (ORCID: https://orcid.org/0009-0007-0993-9785)
- Pawit Phadungsaksawasdi (ORCID: https://orcid.org/0000-0002-6537-2687)
- Thanida Kamolphasukchuen (ORCID: https://orcid.org/0009-0001-7596-8724)
Institutions
- Thammasat University (TH)
- Rangsit University (TH)
Publication Details
- Journal
- JMIR Dermatology
- Published
- 2026-11-17
- DOI
- https://doi.org/10.2196/100364
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.00