Improving sequence labeling with labeled clue sentences

Qianlong Wang, Zhiyuan Wen, Keyang Ding, Qin Zhao, Min Yang, Xiaoqi Yu, Ruifeng Xu

Abstract: Highlights•A general framework uses labeled clues to mitigate labeled data shortages.•Two retrieved ways of labeled clue sentences are designed.•Mask label strategy is devised to avoid over-fitting.•Transformer’s self-attention is modified to exploit original and clue sentences.•We verify effectiveness of the proposed framework on three sequence labeling tasks.