Explainability and Interpretability of Large Language Models in Critical Applications

LLMs have become central to many high-stakes domains, including medical diagnosis, financial forecasting, and autonomous driving. However, the opaqueness of their decision-making process presents significant challenges, especially when deployed in critical applications. This paper investigates the explainability and interpretability of LLMs in high-stakes decision-making contexts. We propose a novel multi-layered framework that enhances interpretability without sacrificing model accuracy. We review viable approaches toward such LLM-based systems as are realized in real time and transparently and credibly for such through an examination of the existing techniques and accompanying domain-specific requirements on interpreting the behavior of. Additionally, we perform empirical research work to evaluate the competitiveness in terms of effectiveness that would be provided by any methodology proposed along with an articulation of a corresponding interpretability-accuracy tradeoff.

Authors

Publication Details

Journal
Journal of Information Systems Engineering & Management
Published
2025-03-06
DOI
https://doi.org/10.52783/jisem.v10i16s.2648
Citations
1
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
2.48
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Explainability and Interpretability of Large Language Models in Critical Applications

Vinod Goje
1 citations
Journal of Information Systems Engineering & Management
Topic Modeling
2.48
article

Explainability and Interpretability of Large Language Models in Critical Applications

Vinod Goje
article en
1 citations

Abstract

LLMs have become central to many high-stakes domains, including medical diagnosis, financial forecasting, and autonomous driving. However, the opaqueness of their decision-making process presents significant challenges, especially when deployed in critical applications. This paper investigates the explainability and interpretability of LLMs in high-stakes decision-making contexts. We propose a novel multi-layered framework that enhances interpretability without sacrificing model accuracy. We review viable approaches toward such LLM-based systems as are realized in real time and transparently and credibly for such through an examination of the existing techniques and accompanying domain-specific requirements on interpreting the behavior of. Additionally, we perform empirical research work to evaluate the competitiveness in terms of effectiveness that would be provided by any methodology proposed along with an articulation of a corresponding interpretability-accuracy tradeoff.

Journal of Information Systems Engineering & ManagementVol. 10(16s)
Openalex Percentile: Top 11%
Topic Modeling
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.