Kronecker Recurrent Units

Cijo Jose, Moustapha Cissé, François Fleuret

Abstract: Our work addresses two important issues with recurrent neural networks: (1) they are over-parametrized, and (2) the recurrent weight matrix is ill-conditioned. The former increases the sample compl...