Measuring Interpretability: A systematic literature review of interpretability measures in artificial intelligence

Advancement in any field requires approaches for measurement. Failure to build such approaches inhibits improvementswithin the field. In the context of interpretability in Artificial Intelligence (AI), a lack of widely adopted evaluationand measurement approaches prevents its advance. While some approaches in literature propose ways to measure interpretability,no consensus exists on objective measurement of interpretability. To advance the state-of-the-art, a clear understandingof these approaches is essential. This paper conducts a systematic review of existing approaches that propose to measure or quantify interpretability and its aspects. The resulting analysis of this review identifies important aspects to consider when measuring interpretability. We found that no approaches directly propose to measure interpretability but instead quantify aspects associated with interpretability. We identify four of these aspects in result of this review.