Understanding and Controlling Memory in Recurrent Neural Networks

Doron Haviv, Alexander Rivkind, Omri Barak

Abstract: To be effective in sequential data processing, Recurrent Neural Networks (RNNs) are required to keep track of past events by creating memories. While the relation between memories and the network’s...