Transformer-based document-level discourse processing: Exploiting prior language knowledge and hierarchical parsing

Open Webpage

Zhengyuan Liu, Ke Shi, Nancy F. Chen

Published: 2025, Last Modified: 07 Oct 2025Comput. Speech Lang. 2025EveryoneRevisionsBibTeXCC BY-SA 4.0
Abstract: Highlights•We propose a Transformer-based discourse parser that incorporates multi-level linguistic features hierarchically.•Our model achieves state-of-the-art performance in multilingual discourse parsing across different languages.•The layer-wise beam search alleviates error propagation, improving inference consistently.•We further explore utilizing discourse information for abstractive summarization.