Autonomous Memory Rehearsal in Associative Memory Networks and its Implications for Biologically Plausible Continuous Learning

Paul SAIGHI, Marcelo ROZENBERG

Track: long paper (up to 5 pages)

Keywords: Hopfield Networks, Associative Memory, Rehearsal, Memory Consolidation, Continuous Learning, Attractor Dynamics, Neuromorphic, Inhibition, Plasticity, Self-organized, Hebbian, Sleep, Replay, Local Learning Rules

TL;DR: Plastic inhibitory synapses enable autonomous memory rehearsal in continuous Hopfield networks, allowing the network to continuously store new correlated patterns using only local, biologically plausible learning rules.

Abstract: The brain's faculty to assimilate and retain information, continually updating its memory while limiting the loss of valuable past information, remains largely a mystery. We address this challenge related to continuous learning in the context of associative memory networks, where the iterative storage of correlated patterns traditionally requires non-local learning rules or external memory systems. Our work demonstrates how incorporating biologically-inspired inhibitory plasticity enables networks to autonomously explore their attractor landscape through local dynamics alone. The autonomous recovery of stored patterns enables continuous addition of new memories by allowing them to be incorporated with previously stored information while limiting its degradation, drawing parallels with memory consolidation during sleep-like states in biological systems. The resulting framework provides insights into how neural circuits might maintain memories through purely local interactions, while suggesting new approaches for building more biologically plausible associative memory systems.

Submission Number: 14