Uncovering the latent dynamics of whole-brain fMRI tasks with a sequential variational autoencoder

Published: 27 Oct 2023, Last Modified: 11 Nov 2023DGM4H NeurIPS 2023 PosterEveryoneRevisionsBibTeX
Keywords: functional magnetic resonance imaging, fMRI, dynamics, sequential variational autoencoder
TL;DR: We propose a model to learn low-dimensional dynamics from voxel-based fMRI data that captures fMRI tasks better
Abstract: The neural dynamics underlying brain activity are critical to understanding cognitive processes and mental disorders. However, current voxel-based whole-brain dimensionality reduction techniques fail to capture these dynamics, producing latent timeseries that inadequately relate to behavioral tasks. To address this issue, we introduce a novel approach to learning low-dimensional approximations of neural dynamics using a sequential variational autoencoder (SVAE) that learns the latent dynamical system. Importantly, our method finds smooth dynamics that can predict cognitive processes with accuracy higher than classical methods, with improved spatial localization to task-relevant brain regions, and we find fixed points for the dynamics that are stable across random initialization of the model.
Submission Number: 53