Hybrid Active Learning with Uncertainty-Weighted Embeddings

Yinan He, Lile Cai, Jingyi Liao, Chuan-Sheng Foo

Abstract: We introduce a hybrid active learning method that simultaneously considers uncertainty and diversity for sample selection. Our method consists of two key steps: computing a novel uncertainty-weighted embedding, then applying distance-based sampling for sample selection. Our proposed uncertainty-weighted embedding is computed by weighting a sample's feature representation by an uncertainty measure. We show how this embedding generalizes the gradient embedding of BADGE so it can be used with arbitrary loss functions and be computed more efficiently, especially for dense prediction tasks and network architectures with large numbers of parameters in the final layer. We extensively evaluate the proposed hybrid active learning method on image classification, semantic segmentation and object detection tasks, and demonstrate that it achieves state-of-the-art performance.

Submission Length: Regular submission (no more than 12 pages of main content)

Changes Since Last Submission: Modified Section 5.4 to elaborate more on the rationale behind the proposed two-term decomposition of gradient embedding and to provide additional experimental results.

Code: https://github.com/He-Yinan/UWE

Assigned Action Editor: ~Mingsheng_Long2

Submission Number: 2088