Using a Large Language Model Chatbot for Allergen Avoidance Counseling in Contact Dermatitis: Quantitative Evaluation Study

Background: AI is increasingly impacting health care. Large language models (LLMs), such as ChatGPT, have shown potential in supporting clinical decision-making. However, their application in dermatology, particularly in allergen avoidance counseling for contact dermatitis, remains underexplored. Objective: This study aimed to demonstrate a potential use case for LLM responses in recommending allergen-free products for the management of contact allergies. Methods: A total of 30 allergen groups included in the international standard patch test were assessed. ChatGPT (GPT-4) was used in this study from September 2023 to January 2024. For each allergen, ChatGPT was tasked with recommending 5 allergen-free products using 3 question formats of varying complexity. Responses were included if they specified a product and were manually classified by dermatologists into 5 categories: valid, invalid, cross-reaction, unknown, and unresponsive. Results: ChatGPT provided 79.20% (1782/2250) valid responses, with 1.78% (40/2250) classified as invalid, 2% (45/2550) classified as cross-reactions, 8.67% (195/2250) classified as unknown, and 8.36% (188/2250) classified as unresponsive. The simplest question format yielded the highest proportion of valid recommendations (640/750, 85.33%). ChatGPT performed best when recommending cosmetics (1233/1365, 90.33%) and medications (198/240, 82.5%). However, lower validity rates were observed for recommendations involving certain sensitive allergens, including fragrance mixes and para-phenylenediamine (PPD), with frequent cross-reactive recommendations related to Peru balsam. Conclusions: The version of ChatGPT evaluated in this study showed potential as a supplementary tool for allergen avoidance counseling. However, its recommendations require verification and should not replace clinician guidance or established allergen avoidance resources.

Authors

Institutions

Publication Details

Journal
JMIR Dermatology
Published
2026-11-17
DOI
https://doi.org/10.2196/100364
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Using a Large Language Model Chatbot for Allergen Avoidance Counseling in Contact Dermatitis: Quantitative Evaluation Study

Poohglin Tresukosol, Pawit Phadungsaksawasdi, Thanida Kamolphasukchuen
4 links
JMIR Dermatology
Artificial Intelligence in Healthcare and Education
article

Using a Large Language Model Chatbot for Allergen Avoidance Counseling in Contact Dermatitis: Quantitative Evaluation Study

Poohglin Tresukosol, Pawit Phadungsaksawasdi, Thanida Kamolphasukchuen
article en

Abstract

Background: AI is increasingly impacting health care. Large language models (LLMs), such as ChatGPT, have shown potential in supporting clinical decision-making. However, their application in dermatology, particularly in allergen avoidance counseling for contact dermatitis, remains underexplored. Objective: This study aimed to demonstrate a potential use case for LLM responses in recommending allergen-free products for the management of contact allergies. Methods: A total of 30 allergen groups included in the international standard patch test were assessed. ChatGPT (GPT-4) was used in this study from September 2023 to January 2024. For each allergen, ChatGPT was tasked with recommending 5 allergen-free products using 3 question formats of varying complexity. Responses were included if they specified a product and were manually classified by dermatologists into 5 categories: valid, invalid, cross-reaction, unknown, and unresponsive. Results: ChatGPT provided 79.20% (1782/2250) valid responses, with 1.78% (40/2250) classified as invalid, 2% (45/2550) classified as cross-reactions, 8.67% (195/2250) classified as unknown, and 8.36% (188/2250) classified as unresponsive. The simplest question format yielded the highest proportion of valid recommendations (640/750, 85.33%). ChatGPT performed best when recommending cosmetics (1233/1365, 90.33%) and medications (198/240, 82.5%). However, lower validity rates were observed for recommendations involving certain sensitive allergens, including fragrance mixes and para-phenylenediamine (PPD), with frequent cross-reactive recommendations related to Peru balsam. Conclusions: The version of ChatGPT evaluated in this study showed potential as a supplementary tool for allergen avoidance counseling. However, its recommendations require verification and should not replace clinician guidance or established allergen avoidance resources.

JMIR DermatologyVol. 9
Thammasat University (TH), Rangsit University (TH)
Good health and well-being
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon