Pre-training language model incorporating domain-specific heterogeneous knowledge into a unified representation

Hongyin Zhu, Hao Peng, Zhiheng Lyu, Lei Hou, Juanzi Li, Jinghui Xiao