Less is More: Discovering Concise Network Explanations

Published: 02 Mar 2024, Last Modified: 02 Mar 2024ICLR 2024 Workshop Re-Align PosterEveryoneRevisionsBibTeXCC BY 4.0
Track: long paper (up to 9 pages)
Keywords: concept, explanations, human, expert, features, similarity, XAI, interpretability
TL;DR: We propose a new method to reduce the complexity of concept-based explanations for users and evaluate our method by measuring the reduced concepts alignment with human-expert features.
Abstract: In this work, we introduce Deep Conceptual Network Explanations (DCNE), an innovative approach designed to generate human-comprehensible visual explanations for the decision-making processes of deep neural image classifiers. Our method finds visual explanations that are critical for discriminating between classes. Our method is designed to simultaneously optimize three criteria: the explanations should be few, diverse, and human-interpretable. Our approach builds on the recently introduced Concept Relevance Propagation (CRP). While CRP is great at comprehensively describing individual neuronal activation, the resulting concepts are far too many to be comprehensible by humans. DCNE selects the few most important explanations from a classifier. To evaluate our method, we collected a novel dataset for classifying birds, comparing our method's explanations to human experts. Compared to existing XAI methods, our approach results in a desirable trade-off between conciseness and completeness when summarizing network explanations. It produces 1/30 of CRP's explanations with only a small loss in explanation quality. This represents a significant step forward in making neural network decisions accessible and interpretable to humans, providing a valuable tool for both researchers and practitioners in the field of explainable artificial intelligence (XAI).
Anonymization: This submission has been anonymized for double-blind review via the removal of identifying information such as names, affiliations, and identifying URLs.
Submission Number: 45
Loading