Do More Negative Samples Necessarily Hurt In Contrastive Learning?

Pranjal Awasthi, Nishanth Dikkala, Pritish Kamath

Abstract: Recent investigations in noise contrastive estimation suggest, both empirically as well as theoretically, that while having more “negative samples” in the contrastive loss improves downstream class...