Match4Rec: A Novel Recommendation Algorithm Based on Bidirectional Encoder Representation with the Matching Task

Lingxiao Zhang, Jiangpeng Yan, Yujiu Yang, Li Xiu

Abstract: Characterizing users’ interests accurately plays a significant role in an effective recommender system. The sequential recommender system can learn powerful hidden representations of users from successive user-item interactions and dynamic users’ preferences. To analyze such sequential data, the use of self-attention mechanisms and bidirectional neural networks have gained much attention recently. However, there exists a common limitation in previous works that they only model the user’s main purposes in the behavioral sequences separately and locally, lacking the global representation of the user’s whole sequential behavior. To address this limitation, we propose a novel bidirectional sequential recommendation algorithm that integrates the user’s local purposes with the global preference by additive supervision of the matching task. Particularly, we combine the mask task with the matching task in the training process of the bidirectional encoder. A new sample production method is also introduced to alleviate the effect of mask noise. Our proposed model can not only learn bidirectional semantics from users’ behavioral sequences but also explicitly produces user representations to capture user’s global preference. Extensive empirical studies demonstrate our approach considerably outperforms various baseline models.