Hierarchical BERT with an adaptive fine-tuning strategy for document classification

Jun Kong, Jin Wang, Xuejie Zhang

Abstract: Highlights•The hierarchical BERT model consist of local encoder and global encoder.•An adaptive fine-tuning strategy improve the performance of the PLMs.•An attention-based gated memory network model global information.