Explainable and fair skin lesion diagnosis via ABCDE-grounded multimodal prompt learning
Deep learning has significantly advanced automated skin cancer diagnosis. However, most existing approaches rely solely on dermoscopic images and lack sufficient clinical context and interpretability. Although these methods often achieve dermatologist level classification accuracy, their limited reasoning transparency restricts clinical trust and broader adoption. This study proposes an explainable multimodal vision-language framework that integrates dermoscopic imagery, structured patient metadata, and ABCDE clinical rule-based dermatological prompts for melanoma-oriented multiclass skin lesion classification and clinically grounded explanation generation. The proposed framework was evaluated on the ISIC 2019 and PAD-UFES-20 datasets, achieving an average accuracy of \(92.4 \pm 0.6\) %. Unlike prior post hoc explanation meth ods, the proposed framework generates grounded visual and text based clinical rationales aligned with skin lesion morphology and ABCDE dermatological cues. Experimental results demonstrate that the framework improves interpretability and transparency by generating clinically aligned model explanations and dermatological reasoning.
Authors
- Akbar Kushanoor (ORCID: https://orcid.org/0009-0004-0812-2608)
- Sanjay K. Sahay
Institutions
- Welch Foundation (US)
- Birla Institute of Technology and Science, Pilani - Goa Campus (IN)
- Birla Institute of Technology and Science, Pilani (IN)
Publication Details
- Journal
- BMC Medical Informatics and Decision Making
- Published
- 2026-09-25
- DOI
- https://doi.org/10.1186/s12911-026-03836-z
- Primary Topic
- Cutaneous Melanoma Detection and Management
- Type
- article
- Field-Weighted Citation Impact
- 0.00