Time-Aware Language Modeling for Historical Text Dating
Submission Type: Regular Long Paper
Submission Track: NLP Applications
Submission Track 2: Discourse and Pragmatics
Keywords: Text Dating, Diachronic Text Evaluation, Time-Aware Language Model, Temporal Adaption, Hierarchical Model
TL;DR: This paper proposes a language model for temporal word representation learning, and build a hierarchical document model based on it for dating long diachronic documents.
Abstract: Automatic text dating(ATD) is a challenging task since explicit temporal mentions usually do not appear in texts. Existing state-of-the-art approaches learn word representations via language models, whereas most of them ignore diachronic change of words, which may affect the efforts of text modeling. Meanwhile, few of them consider text modeling for long diachronic documents. In this paper, we present a time-aware language model named TALM, to learn temporal word representations by transferring language models of general domains to those of time-specific ones. We also build a hierarchical modeling approach to represent diachronic documents by encoding them with temporal word representations. Experiments on a Chinese diachronic corpus show that our model effectively captures implicit temporal information of words, and outperforms state-of-the-art approaches in historical text dating as well.
Submission Number: 3854
Loading