Improving Relevance Prediction with Transfer Learning in Large-scale Retrieval SystemsDownload PDF


16 May 2019 (modified: 14 Jun 2019)ICML 2019 Workshop AMTL Blind SubmissionReaders: Everyone
  • Keywords: Transfer Learning, Retrieval System, Explicit Feedback, Two tower Neural Network, Multitask Learning
  • TL;DR: We propose a novel two-tower shared-bottom model architecture for transferring knowledge from rich implicit feedbacks to predict relevance for large-scale retrieval systems.
  • Abstract: Machine learned large-scale retrieval systems require a large amount of training data representing query-item relevance. However, collecting users' explicit feedback is costly. In this paper, we propose to leverage user logs and implicit feedback as auxiliary objectives to improve relevance modeling in retrieval systems. Specifically, we adopt a two-tower neural net architecture to model query-item relevance given both collaborative and content information. By introducing auxiliary tasks trained with much richer implicit user feedback data, we improve the quality and resolution for the learned representations of queries and items. Applying these learned representations to an industrial retrieval system has delivered significant improvements.
0 Replies