Semi-supervised Autoencoding Projective Dependency Parsing

Xiao Zhang, Dan Goldwasser

TL;DR: We describe two end-to-end autoencoding parsers for semi-supervised graph-based dependency parsing.

Abstract: We describe two end-to-end autoencoding models for semi-supervised graph-based dependency parsing. The first model is a Local Autoencoding Parser (LAP) encoding the input using continuous latent variables in a sequential manner; The second model is a Global Autoencoding Parser (GAP) encoding the input into dependency trees as latent variables, with exact inference. Both models consist of two parts: an encoder enhanced by deep neural networks (DNN) that can utilize the contextual information to encode the input into latent variables, and a decoder which is a generative model able to reconstruct the input. Both LAP and GAP admit a unified structure with different loss functions for labeled and unlabeled data with shared parameters. We conducted experiments on WSJ and UD dependency parsing data sets, showing that our models can exploit the unlabeled data to boost the performance given a limited amount of labeled data.

Keywords: Dependency Parsing, Semi-supervised Learning, Tractable Inference, Evidence Lowerbound