SLDT: Sequential Latent Document Transformer for Multilingual Document-based Dialogue

Anonymous

Paper Type: long - archival

Keywords: Multi-Lingual, Document-Knowledge, Dialogue

TL;DR: SLDT: Sequential Latent Document Transformer for Multilingual Document-based Dialogue

Abstract:

Multilingual document-grounded dialogue, where the system is required to generate responses based on both the conversation Multilingual context and external knowledge sources.
Traditional pipeline methods for knowledge identification and response generation, while effective in certain scenarios, suffer from error propagation issues and fail to capture the interdependence between these two sub-tasks. To overcome these challenges, we propose the application of the SLDT method, which treats passage-knowledge selection as a sequential decision process rather than a single-step decision process.
We achieved winner 3rd in dialdoc 2023 and we also validated the effectiveness of our method on other datasets. The ablation experiment also shows that our method significantly improves the basic model compared to other methods.