Open Peer Review. Open Publishing. Open Access. Open Discussion. Open Directory. Open Recommendations. Open API. Open Source.
Learning Operations on a Stack with Neural Turing Machines
Oct 14, 2016 (modified: Oct 14, 2016)NIPS 2016 workshop NAMPI submissionreaders: everyone
Abstract:Multiple extensions of Recurrent Neural Networks (RNNs) have been proposed recently to address the difficulty of storing information over long time periods. In this paper, we experiment with the capacity of Neural Turing Machines (NTMs) to deal with these long-term dependencies on well-balanced strings of parentheses. We show that not only does the NTM emulate a stack with its heads and learn an algorithm to recognize such words, but it is also capable of strongly generalizing to much longer sequences.
TL;DR:We show how the NTM can emulate a stack to recognize well-balanced strings of parentheses, enabling strong generalization to longer sequences.
Keywords:Deep learning, Supervised Learning
Enter your feedback below and we'll get back to you as soon as possible.