Deep Batch Active Learning by Diverse, Uncertain Gradient Lower BoundsDownload PDF

Published: 20 Dec 2019, Last Modified: 03 Apr 2024ICLR 2020 Conference Blind SubmissionReaders: Everyone
TL;DR: We introduce a new batch active learning algorithm that's robust to model architecture, batch size, and dataset.
Abstract: We design a new algorithm for batch active learning with deep neural network models. Our algorithm, Batch Active learning by Diverse Gradient Embeddings (BADGE), samples groups of points that are disparate and high-magnitude when represented in a hallucinated gradient space, a strategy designed to incorporate both predictive uncertainty and sample diversity into every selected batch. Crucially, BADGE trades off between diversity and uncertainty without requiring any hand-tuned hyperparameters. While other approaches sometimes succeed for particular batch sizes or architectures, BADGE consistently performs as well or better, making it a useful option for real world active learning problems.
Keywords: deep learning, active learning, batch active learning
Code: [![github](/images/github_icon.svg) JordanAsh/badge]( + [![Papers with Code](/images/pwc_icon.svg) 3 community implementations](
Data: [CIFAR-10](, [MNIST](, [SVHN](
Community Implementations: [![CatalyzeX](/images/catalyzex_icon.svg) 1 code implementation](
Original Pdf: pdf
8 Replies