Is Incremental Structure Prediction Process Universal across Languages?:Revisiting Parsing Strategy through Speculation

Taiga Ishii, Yusuke Miyao

Keywords: parsing strategy, syntactic language modeling, speculation, language universal

TL;DR: This study examines whether incremental parsing strategies are language-universal in syntactic language modeling.

Abstract: While natural language is processed incrementally, it is unclear whether the syntactic structure prediction process is universal across languages or language-specific. This study investigates this question by revisiting parsing strategies of syntactic language models that incrementally predict both the next token and the associated syntactic structure. Unlike previous studies that have focused on a few strategies, we examine a wide range of strategies by introducing different parameterizations of speculation, which quantifies the degree to which a model predicts syntactic structure before encountering the corresponding tokens. The experiments with 10 typologically diverse languages reveal that the optimal strategy differs depending on the language and the beam size.

Submission Number: 177