Comparative Evaluation of Post-Hoc Explainability Methods in AI: LIME, SHAP, and Grad-CAM

This research study presents a comparative evaluation of three prominent post-hoc explain ability methods: LIME (Local Interpretable Model-agnostic Explanations), SHAP (SHapley Additive exPlanations), and Grad-CAM (Gradient-weighted Class Activation Mapping). The evaluation is performed using a simple Convolutional Neural Network (CNN) model trained on the MNIST dataset. To achieve high accuracy, the CNN model was optimized through rigorous training and evaluation, reaching a test accuracy of approximately 98%. The evaluation involves applying each method to selected test images and comparing their effectiveness in terms of interpretability and visualization. LIME provides local feature importance by highlighting influential regions in the images, while SHAP offers a model-agnostic perspective with Shapley values that quantify feature contributions. Grad-CAM visualizes class-specific activation maps, showing which parts of the image contribute to predictions This study provides valuable insights into the strengths and limitations of each explainability method, helping practitioners understand their practical applications and choose the most suitable technique based on their specific needs.

Authors

Institutions

Publication Details

Published
2024-10-15
DOI
https://doi.org/10.1109/icses63445.2024.10762963
Citations
22
Primary Topic
Explainable Artificial Intelligence (XAI)
Type
article
Field-Weighted Citation Impact
7.64
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comparative Evaluation of Post-Hoc Explainability Methods in AI: LIME, SHAP, and Grad-CAM

Jeet Narkhede
22 citations
Explainable Artificial Intelligence (XAI)
7.64
article

Comparative Evaluation of Post-Hoc Explainability Methods in AI: LIME, SHAP, and Grad-CAM

Jeet Narkhede
article en
22 citations

Abstract

This research study presents a comparative evaluation of three prominent post-hoc explain ability methods: LIME (Local Interpretable Model-agnostic Explanations), SHAP (SHapley Additive exPlanations), and Grad-CAM (Gradient-weighted Class Activation Mapping). The evaluation is performed using a simple Convolutional Neural Network (CNN) model trained on the MNIST dataset. To achieve high accuracy, the CNN model was optimized through rigorous training and evaluation, reaching a test accuracy of approximately 98%. The evaluation involves applying each method to selected test images and comparing their effectiveness in terms of interpretability and visualization. LIME provides local feature importance by highlighting influential regions in the images, while SHAP offers a model-agnostic perspective with Shapley values that quantify feature contributions. Grad-CAM visualizes class-specific activation maps, showing which parts of the image contribute to predictions This study provides valuable insights into the strengths and limitations of each explainability method, helping practitioners understand their practical applications and choose the most suitable technique based on their specific needs.

Mitra Biotech (India) (IN)
Quality Education
Openalex Percentile: Top 2%
Explainable Artificial Intelligence (XAI)
7.64
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.