Learning to Rank for Active Learning via Multi-Task Bilevel Optimization

Zixin Ding, Si Chen, Ruoxi Jia, Yuxin Chen

Keywords: Active Learning, Multi-Task Learning, Bilevel Optimization, Utility Model

TL;DR: A novel learning-based approach for one-round active learning.

Abstract: Active learning is a promising paradigm for reducing labeling costs by strategically requesting labels to improve model performance. However, existing active learning methods often rely on expensive acquisition functions, extensive model retraining, and multiple rounds of interaction with annotators. To address these limitations, we propose a novel approach for active learning, which aims to select batches of unlabeled instances through a learned surrogate model for data acquisition. A key challenge in this approach is to develop an acquisition function that generalizes well, as the history of data, which forms part of the utility function's input, grows over time. Our novel algorithmic contribution is a multi-task bilevel optimization framework that predicts the relative utility---measured by the validation accuracy---of different training sets, and ensures the learned acquisition function generalizes effectively. For cases where validation accuracy is expensive to evaluate, we introduce efficient interpolation-based surrogate models to estimate the utility function, reducing the evaluation cost. We demonstrate the performance of our approach through extensive experiments on standard active classification benchmarks.

List Of Authors: Ding, Zixin and Chen, Si and Jia, Ruoxi and Chen, Yuxin

Submission Number: 703