Fast Parametric Learning with Activation Memorization

Jack W. Rae, Chris Dyer, Peter Dayan, Timothy P. Lillicrap

Abstract: Neural networks trained with backpropagation often struggle to identify classes that have been observed a small number of times. In applications where most class labels are rare, such as language m...