Cross-modal adapter for vision-language retrieval

Haojun Jiang, Jianke Zhang, Rui Huang, Chunjiang Ge, Zanlin Ni, Shiji Song, Gao Huang

Abstract: Highlights•We propose a novel Cross-Modal Adapter for vision-language retrieval.•We design a weight-sharing mechanism to facilitate cross-modal alignment.•Experiments on five mainstream retrieval tasks show the effectiveness of our method.