Emergence of compositional language in communication through noisy channel

Łukasz Kuciński, Paweł Kołodziej, Piotr Miłoś

Abstract: In this paper, we investigate how communication through a noisy channel can lead to the emergence of compositional language. Our approach is $\mbox{end-to-end}$, allows for different inductive biases on the agents’ architecture, and trains without periodical resets of the networks’ weights. This relaxes some of the assumptions in recently developed methods. The impact on the structure of the resulting language is shown in the context of signaling games. We also develop a new metric for measuring degree of compositionality.

TL;DR: We investigate how communication through a noisy channel can lead to the emergence of compositional language

Keywords: language, compositionality, communication, signaling games