Predictive Coding with Topographic Variational AutoencodersDownload PDF

Published: 06 Aug 2021, Last Modified: 05 May 2023VIPriors 2021 OralPosterTBDReaders: Everyone
Keywords: Topographic, Equivariant, Capsule, VAE, Predictive Coding, Self-supervised, Unsupervised
TL;DR: We extend the Topographic VAE with the inductive bias of predictive coding and demonstrate improved forward prediction of sequences.
Abstract: Predictive coding is a model of visual processing which suggests that the brain is a generative model of input, with prediction error serving as a signal for both learning and attention. In this work, we show how the equivariant capsules learned by a Topographic Variational Autoencoder can be extended to fit within the predictive coding framework by treating the slow rolling of capsule activations as the forward prediction operator. We demonstrate quantitatively that such an extension leads to improved sequence modeling compared with both topographic and non-topographic baselines, and that the resulting forward predictions are qualitatively more coherent with the provided partial input transformations.
1 Reply

Loading