BIGRoC: Boosting Image Generation via a Robust Classifier

Roy Ganz, Michael Elad

Keywords: Image Generation, Adversarial Robustness, Perceptually Aligned Gradients

Abstract: The interest of the machine learning community in image synthesis has grown significantly in recent years, with the introduction of a wide range of deep generative models and means for training them. Such machines’ ultimate goal is to match the distributions of the given training images and the synthesized ones. In this work, we propose a general model-agnostic technique for improving the image quality and the distribution fidelity of generated images, obtained by any generative model. Our method, termed BIGRoC (boosting image generation via a robust classifier), is based on a post-processing procedure via the guidance of a given robust classifier and without a need for additional training of the generative model. Given a synthesized image, we propose to update it through projected gradient steps over the robust classifier, in an attempt to refine its recognition. We demonstrate this post-processing algorithm on various image synthesis methods and show a significant improvement of the generated images, both quantitatively and qualitatively.

One-sentence Summary: A model-agnostic post-processing that relies on a robust classifier is shown to boost the quality of synthesized images.

Community Implementations: [ 5 code implementations](https://www.catalyzex.com/paper/arxiv:2108.03702/code)