Use perturbations when learning from explanations

Juyeon Heo, Vihari Piratla, Matthew Robert Wicker, Adrian Weller

Keywords: Learning from explanation, Robustness, Interpretability, Shortcuts, Explanations

TL;DR: We recast Machine learning from explanations (MLX) as a robustness problem and show both theoretically and empirically how this approach is better suited for learning from explanations.

Abstract: Machine learning from explanations (MLX) is an approach to learning that uses human-provided explanations of relevant or irrelevant features for each input to ensure that model predictions are right for the right reasons. Existing MLX approaches rely on local model interpretation methods and require strong model smoothing to align model and human explanations, leading to sub-optimal performance. We recast MLX as a robustness problem, where human explanations specify a lower dimensional manifold from which perturbations can be drawn, and show both theoretically and empirically how this approach alleviates the need for strong model smoothing. We consider various approaches to achieving robustness, leading to improved performance over prior MLX methods. Finally, we show how to combine robustness with an earlier MLX method, yielding state-of-the-art results on both synthetic and real-world benchmarks.

Submission Number: 12114