A fully differentiable beam search decoder

Ronan Collobert, Awni Hannun, Gabriel Synnaeve

Abstract: We introduce a new beam search decoder that is fully differentiable, making it possible to optimize at training time through the inference procedure. Our decoder allows us to combine models which o...