Demystifying XAI: Understanding of Applications, Limitations, Challenges, and Future Perspectives

Artificial Intelligence (AI) appears to be omnipresent, but its usability is currently a pain point as seen with automation bias. The General Data Protection Regulation (GDPR) has started solving this problem. The premise behind Explainable AI (XAI) is described as making AI decisions interpretable, gaining user trust and robustness of applications in healthcare and finance. This paper gives a survey of recent XAI advancements, providing types of algorithms, and examples of tasks. Despite the concept of XAI, we still have the black-box issue of AI, and especially in critical areas like healthcare with sensitive information, we need to protect user privacy. It is proposed that XAI can expose the decision-making process of the AI, to make the AI decision-making more reliable and trustworthy. Evaluation metrics and potential future directions for XAI are discussed, with a guiding principle: AI needs to be ethical, trustworthy, and user-friendly.

Authors

Publication Details

Published
2024-09-27
DOI
https://doi.org/10.1109/acroset62108.2024.10743621
Citations
1
Primary Topic
Scientific Computing and Data Management
Type
article
Field-Weighted Citation Impact
1.05
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Demystifying XAI: Understanding of Applications, Limitations, Challenges, and Future Perspectives

P.K. Varshney, Narendra Pal Singh Rathore, Kamal Kumar Sethi, Shiv Shankar Rajput
1 citations
Scientific Computing and Data Management
1.05
article

Demystifying XAI: Understanding of Applications, Limitations, Challenges, and Future Perspectives

P.K. Varshney, Narendra Pal Singh Rathore, Kamal Kumar Sethi, Shiv Shankar Rajput
article en
1 citations

Abstract

Artificial Intelligence (AI) appears to be omnipresent, but its usability is currently a pain point as seen with automation bias. The General Data Protection Regulation (GDPR) has started solving this problem. The premise behind Explainable AI (XAI) is described as making AI decisions interpretable, gaining user trust and robustness of applications in healthcare and finance. This paper gives a survey of recent XAI advancements, providing types of algorithms, and examples of tasks. Despite the concept of XAI, we still have the black-box issue of AI, and especially in critical areas like healthcare with sensitive information, we need to protect user privacy. It is proposed that XAI can expose the decision-making process of the AI, to make the AI decision-making more reliable and trustworthy. Evaluation metrics and potential future directions for XAI are discussed, with a guiding principle: AI needs to be ethical, trustworthy, and user-friendly.

Openalex Percentile: Top 12%
Scientific Computing and Data Management
1.05
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Demystifying XAI: Understanding of Applications, Limitations, Challenges, and Future Perspectives — P.K. Varshney, Narendra Pal Singh Rathore, et al. · (2024) | TGRS Research Map | TGRS