A General Method for Testing Bayesian Models using Neural Data
Supplementary Material: pdf
Keywords: neuroscience, method, Bayesian models, probabilistic neural codes, neural sampling, distributed distributional codes (DDC), linear distributional codes (LDC), representational similarity (RSA)
TL;DR: Our method tests whether the relationships between the posteriors within the model match the relationships between the corresponding neural responses – like RSA, but for probabilistic models - assuming linear distributional encoding (sampling or DDC)
Abstract: Bayesian models have been successful in explaining human and animal behavior, but the extent to which they can also explain neural activity is still an open question. A major obstacle to answering this question is that current methods for generating neural predictions require detailed and specific assumptions about the encoding of posterior beliefs in neural responses, with no consensus or decisive data about the nature of this encoding. Here, we present a new method and prove conditions for its validity, that overcomes these challenges for a wide class of probabilistic encodings -- including the two major classes of neural sampling and distributed distributional codes. Our method tests whether the relationships between the model posteriors for different stimuli match the relationships between the corresponding neural responses -- akin to representational similarity analysis (RSA), a widely used method for nonprobabilistic models. Finally, we present a new model comparison diagnostic for our method, based not on the agreement of the model with the data directly, but on the alignment of the model and data when injecting noise in our neural prediction generation method. We illustrate our method using simulated V1 data and compare two Bayesian models that are practically indistinguishable using behavior alone. Our results show a powerful new way to rigorously test Bayesian models on neural data.
Track: Proceedings Track
Submission Number: 42
Loading