Generating counterfactual negative samples for image-text matching

Xinqi Su, Dan Song, Wenhui Li, Tongwei Ren, An-An Liu

Abstract: Highlights•A training scheme enhances the model’s semantic and dependency sensitivity.•A feature-level negative sample module that effectively discovers key semantics.•A relation-level negative sample module uncovers critical semantic dependencies.