Adaptive Associative Memory with Differentiable Content-Addressable Memories for Online Learning

Sara Ameli, Ming-Jay Yang, Rishabh Mallik

Keywords: associative memory, content-addressable memory, differentiable CAM, continual learning, stability–plasticity tradeoff, distribution shift, representation shift, analog memory

TL;DR: We show that differentiable content-addressable memories enable soft associative retrieval and online adaptation, allowing robust memory rebinding under distribution and representation shifts with a controllable stability–plasticity tradeoff.

Abstract:

Associative memory is a unifying abstraction underlying attention mechanisms, energy-based models, and adaptive inference systems. Analog content-addressable memories (CAMs) enable graded similarity search directly in hardware, supporting soft retrieval and online adaptation within a single substrate.
We study differentiable CAM (diff-CAM) as a general associative memory primitive. Through controlled simulations, we characterize its retrieval robustness, learning dynamics, and stability–plasticity tradeoffs under distribution drift and representation shift. Compared to static CAMs, adaptive diff-CAM exhibits rapid rebinding and improved associative inference under non-stationary inputs. These
results position diff-CAM as a hardware-aligned substrate for efficient and adaptive memory-augmented systems

Submission Number: 49