Forecasting Whole-Brain Neuronal Activity from Volumetric Video

Alexander Immer, Jan-Matthis Lueckmann, Alex Bo-Yuan Chen, Peter H. Li, Mariela D Petkova, Nirmala A Iyer, Aparna Dev, Gudrun Ihrke, Woohyun Park, Alyson Petruncio, Aubrey Weigel, Wyatt Korff, Florian Engert, Jeff Lichtman, Misha B. Ahrens, Viren Jain, Michal Januszewski

Reviewer: ~Alexander_Immer1

Presenter: ~Alexander_Immer1

TL;DR: We propose a new method for forecasting neuronal activity using volumetric videos, leveraging spatial relationships between neurons and outperforming traditional trace-based methods.

Abstract: Large-scale neuronal activity recordings with fluorescent calcium indicators are increasingly common, yielding high-resolution 2D or 3D videos. Traditional analysis pipelines reduce this data to 1D traces by segmenting regions of interest, leading to inevitable information loss. Inspired by the success of deep learning on minimally processed data in other domains, we investigate the potential of forecasting neuronal activity directly from volumetric videos. To capture long-range dependencies in high-resolution volumetric whole-brain recordings, we design a model with large receptive fields, which allow it to integrate information from distant regions within the brain. Our model outperforms trace-based forecasting approaches on ZAPBench, a benchmark on whole-brain activity prediction in zebrafish, demonstrating the advantages of preserving the spatial structure of neuronal activity. We perform extensive model selection, analyze effects of input resolution and spatio-temporal trade-offs, explore the impact of pre-training, provide comprehensive controls, and propose complementary performance metrics.

Length: long paper (up to 8 pages)

Domain: methods

Format Check: Maybe: the presenting author will attend in person, contingent on other factors that still need to be determined (e.g., visa, funding).

Author List Check: The author list is correctly ordered and I understand that additions and removals will not be allowed after the abstract submission deadline.

Anonymization Check: This submission has been anonymized for double-blind review via the removal of identifying information such as names, affiliations, and URLs that point to identifying information.

Submission Number: 24