Regularizing attention scores with bootstrapping

Neo Christopher Chung, Maxim Laletin

TL;DR: Attention scores in transformers are regularized by the bootstrapping, resulting in more sparse and interpretable explanations.

Abstract: Vision transformers (ViT) rely on attention mechanism to weigh input features, and therefore attention scores have naturally been considered as explanations for its decision-making process. However, attention scores are almost always non-zero, resulting in noisy attention maps and limiting interpretability. Can we quantify uncertainty measures of attention scores and obtain regularized attention scores? To this end, we consider attention scores of ViT in a statistical framework where, e.g., noise would lead to insignificant yet non-zero scores. Leveraging statistical learning techniques, we introduce the bootstrapping for attention scores which generates a baseline distribution of attention scores by resampling input features. Such a bootstrap distribution is then used to estimate significances and posterior probabilities of attention scores. In natural and medical images, the proposed Attention Regularization approach demonstrates a straightforward removal of spurious attention arising from noise, drastically improving shrinkage and sparsity. Quantitative evaluations are conducted using both simulation and real-world datasets. Our study highlights bootstrapping as a practical regularization tool when using attention scores as explanations for ViT.

Code Dataset Promise: Yes

Code Dataset Url: https://github.com/ncchung/AttentionRegularization

Format Confirmation: I agree that I have read and followed the formatting instructions for the camera ready version.

Submission Number: 2347