Extracting task-relevant preserved dynamics from contrastive aligned neural recordings

Yiqi Jiang, Kaiwen Sheng, Yujia Gao, E. Kelly Buchanan, Fatih Dinc, Yu Shikano, Tony Hyun Kim, Seung Je Woo, Yixiu Zhao, Scott Linderman, Mark Schnitzer

Reviewer: ~Kaiwen_Sheng1

Presenter: ~Yiqi_Jiang2

Abstract: Recent work indicates that low-dimensional dynamics of neural and behavioral data are often preserved across days and subjects. However, extracting these preserved dynamics remains challenging: high-dimensional neural population activity and the recorded neuron populations vary across recording sessions. While existing modeling tools can improve alignment between neural and behavioral data, they often operate on a per-subject basis or discretize behavior into categories, disrupting its natural continuity and failing to capture the underlying dynamics. We introduce $\underline{\text{C}}$ontrastive $\underline{\text{A}}$ligned $\underline{\text{N}}$eural $\underline{\text{D}}$$\underline{\text{Y}}$namics (CANDY), an end‑to‑end framework that aligns neural and behavioral data using rank-based contrastive learning, adapted for continuous behavioral variables, to project neural activity from different sessions onto a shared low-dimensional embedding space. CANDY fits a shared linear dynamical system to the aligned embeddings, enabling an interpretable model of the conserved temporal structure in the latent space. We validate CANDY on several datasets, spanning multiple species, behaviors and recording modalities. Our results show that CANDY is able to learn aligned latent embeddings and preserved dynamics across sessions and subjects, and it achieves improved cross-session behavior decoding performance. We further show that the latent linear dynamical system generalizes to new sessions and subjects, achieving behavior decoding performance that can match and even outperform models trained from scratch on the new datasets. These advances enable robust cross‑session behavioral decoding and offer a path towards identifying shared neural dynamics that underlie behavior across individuals and recording conditions.

Length: long paper (up to 8 pages)

Domain: data, methods

Format Check: Yes, the presenting author will attend in person if this work is accepted to the workshop.

Author List Check: The author list is correctly ordered and I understand that additions and removals will not be allowed after the abstract submission deadline.

Anonymization Check: This submission has been anonymized for double-blind review via the removal of identifying information such as names, affiliations, and URLs that point to identifying information.

Submission Number: 21