DelibGAN: Coarse-to-Fine Text Generation via Adversarial Network

Ke Wang, Xiaojun Wan

Abstract: In this paper, we propose a novel adversarial learning framework, namely DelibGAN, for generating high-quality sentences without supervision. Our framework consists of a coarse-to-fine generator, which contains a first-pass decoder and a second-pass decoder, and a multiple instance discriminator. And we propose two training mechanisms DelibGAN-I and DelibGAN-II. The discriminator is used to fine-tune the second-pass decoder in DelibGAN-I and further evaluate the importance of each word and tune the first-pass decoder in DelibGAN-II. We compare our models with several typical and state-of-the-art unsupervised generic text generation models on three datasets (a synthetic dataset, a descriptive text dataset and a sentimental text dataset). Both qualitative and quantitative experimental results show that our models produce more realistic samples, and DelibGAN-II performs best.

Keywords: unsupervised text generation, coarse-to-fine generator, multiple instance discriminator, GAN, DelibGAN

TL;DR: A novel adversarial learning framework, namely DelibGAN, is proposed for generating high-quality sentences without supervision.