Nested LSTMs

Joel Ruben Antony Moniz, David Krueger

Abstract: We propose \emphNested LSTMs (NLSTM), a novel RNN architecture with multiple levels of memory. Nested LSTMs add depth to LSTMs via nesting as opposed to stacking. The value of a memory cell in an N...