LEARNING AND ANALYZING VECTOR ENCODING OF SYMBOLIC REPRESENTATION

Roland Fernandez, Aslı C¸elikyılmaz, Paul Smolensky, Rishabh Singh

• Keywords: Knowledge, Representation, Embedding, Symbolic Structure, Encoder Decoder, Deep Learning, Vector Space
• TL;DR: We present an expression language for representing and querying structured symbolic information and use it to train an encoder decoder network to represent the expressions as fixed size decodable embedding vectors.
• Abstract: We present a formal language with expressions denoting general symbol structures and queries which access information in those structures. A sequence-to-sequence network processing this language learns to encode symbol structures and query them. The learned representation (approximately) shares a simple linearity property with theoretical techniques for performing this task.