Adversarial Training of Neural Encoding Models on Population Spike Trains

Poornima Ramesh, Mohamad Atayi, Jakob H Macke

Abstract: Neural population responses to sensory stimuli can exhibit both nonlinear stimulus- dependence and richly structured shared variability. Here, we show how adversarial training can be used to optimize neural encoding models to capture both the deterministic and stochastic components of neural population data. To account for the discrete nature of neural spike trains, we use the REBAR method to estimate unbiased gradients for adversarial optimization of neural encoding models. We illustrate our approach on population recordings from primary visual cortex. We show that adding latent noise-sources to a convolutional neural network yields a model which captures both the stimulus-dependence and noise correlations of the population activity.

Keywords: neural encoding models, neural variability, GANs, visual system, conditional GANs

TL;DR: We show how neural encoding models can be trained to capture both the signal and spiking variability of neural population data using GANs.