On the Surrogate Gap between Contrastive and Supervised Losses

Han Bao, Yoshihiro Nagano, Kento Nozawa

Abstract: Contrastive representation learning encourages data representation to make semantically similar pairs closer than randomly drawn negative samples, which has been successful in various domains such ...