Augmenting Classic Algorithms with Neural Components for Strong Generalisation on Ambiguous and High-Dimensional DataDownload PDF

Published: 23 Oct 2021, Last Modified: 05 May 2023AIPLANSReaders: Everyone
Keywords: neuro-symbolic, symbol representation, insertion sort, odd-even transposition sort, mnist, out of distribution generalisation
TL;DR: We learn to sort mnist images.
Abstract: We augment classic algorithms with learned components to adapt them to domains currently dominated by deep learning models. Two traditional sorting algorithms with learnable neural building blocks are applied to visual data with apriori unknown symbols and rules. The models are quickly and reliably trained end-to-end in a supervised setting. Our models learn symbol representations and generalise better than generic neural network models to longer input sequences.
1 Reply