Modeling Category-Selective Cortical Regions with Topographic Variational AutoencodersDownload PDF

Published: 02 Nov 2021, Last Modified: 05 May 2023SVRHM 2021 OralReaders: Everyone
Keywords: Category Selectivity, Biologically Inspired, Generative Model, Topographic Organization, Variational Autoencoder
TL;DR: We show that Topographic VAEs trained on realistic images yield localized clusters of neurons selective to faces, bodies, and places.
Abstract: Category-selectivity in the brain describes the observation that certain spatially localized areas of the cerebral cortex tend to respond robustly and selectively to stimuli from specific limited categories. One of the most well known examples of category-selectivity is the Fusiform Face Area (FFA), an area of the inferior temporal cortex in primates which responds preferentially to images of faces when compared with objects or other generic stimuli. In this work, we leverage the newly introduced Topographic Variational Autoencoder to model of the emergence of such localized category-selectivity in an unsupervised manner. Experimentally, we demonstrate our model yields spatially dense neural clusters selective to faces, bodies, and places through visualized maps of Cohen's d metric. We compare our model with related supervised approaches, namely the Topographic Deep Articifial Neural Network (TDANN) of Lee et al., and discuss both theoretical and empirical similarities. Finally, we show preliminary results suggesting that our model yields a nested spatial hierarchy of increasingly abstract categories, analogous to observations from the human ventral temporal cortex.
8 Replies