Statistical Property Testing for Generative Models

Emmanouil Seferis, Simon Burton, Chih-Hong Cheng

Keywords: Generative Models, Statistical Testing

TL;DR: We present a simple method to check whether data produced by generative models satisfy some properties, with a given confidence level.

Abstract: Generative models that produce images, text, or other types of data are recently be equipped with more powerful capabilities. Nevertheless, in some use cases of the generated data (e.g., using it for model training), one must ensure that the synthetic data points satisfy some properties that make them suitable for the intended use. Towards this goal, we present a simple framework to statistically check if the data produced by a generative model satisfy some property with a given confidence level. We apply our methodology to standard image and text-to-image generative models.