Soft prompt tuning for augmenting dense retrieval with large language models

Zhiyuan Peng, Xuyang Wu, Qifan Wang, Yi Fang

Abstract: Highlights•First to use LLMs with soft prompt tuning for augmenting dense retrieval tasks.•Novel soft prompt filter improves weak data quality.•Experiments show our method outperforms strong baselines.•Uses open-source LLMs for reproducible, robust results.