Data Distribution Valuation Using Generalized Bayesian Inference

Cuong N. Nguyen, Cuong V. Nguyen

TL;DR: We develop a new generalized Bayesian framework for data distribution valuation.

Abstract: We investigate the data distribution valuation problem, which aims to quantify the values of data distributions from their samples. This is a recently proposed problem that is related to but different from classical data valuation and can be applied to various applications. For this problem, we develop a novel framework called *Generalized Bayes Valuation* that utilizes generalized Bayesian inference with a loss constructed from transferability measures. This framework allows us to solve, in a unified way, seemingly unrelated practical problems, such as annotator evaluation and data augmentation. Using the Bayesian principles, we further improve and enhance the applicability of our framework by extending it to the continuous data stream setting. Our experiment results confirm the effectiveness and efficiency of our framework in different real-world scenarios.

Code Dataset Promise: Yes

Code Dataset Url: https://github.com/CuongNN218/GBV

Format Confirmation: I agree that I have read and followed the formatting instructions for the camera ready version.

Submission Number: 1259