An Empirical Exploration of Recurrent Network Architectures

Rafal Józefowicz, Wojciech Zaremba, Ilya Sutskever

Abstract: The Recurrent Neural Network (RNN) is an extremely powerful sequence model that is often difficult to train. The Long Short-Term Memory (LSTM) is a specific RNN architecture whose design makes it m...