Cross-modal adapter for vision–language retrieval

Haojun Jiang, Jianke Zhang, Rui Huang, Chunjiang Ge, Zanlin Ni, Shiji Song, Gao Huang

Abstract: Highlights•We propose a novel Cross-Modal Adapter for vision-language retrieval.•We design a weight-sharing mechanism to facilitate cross-modal alignment.•Experiments on five mainstream retrieval tasks show the effectiveness of our method.

External IDs:doi:10.1016/j.patcog.2024.111144