Adversarial Audio Synthesis

Chris Donahue, Julian McAuley, Miller Puckette

Sep 27, 2018 ICLR 2019 Conference Blind Submission readers: everyone Show Bibtex
  • Abstract: While Generative Adversarial Networks (GANs) have seen wide success at the problem of synthesizing realistic images, they have seen little application to audio generation. Unlike for images, a barrier to success is that the best discriminative representations for audio tend to be non-invertible, and thus cannot be used to synthesize listenable outputs. In this paper we introduce WaveGAN, a first attempt at applying GANs to unsupervised synthesis of raw-waveform audio. WaveGAN is capable of synthesizing one second audio waveforms with temporal coherence, suitable for sound effect generation. Our experiments demonstrate that WaveGAN can produce intelligible words from a small vocabulary of speech, and can also synthesize audio from other domains such as drums, bird vocalizations, and piano. Qualitatively, we find that human judges prefer the sound quality of generated examples from WaveGAN over those from a method which na├»vely apply GANs on image-like audio feature representations.
  • Keywords: audio, waveform, spectrogram, GAN, adversarial, WaveGAN, SpecGAN
  • TL;DR: Learning to synthesize raw waveform audio with GANs
0 Replies