Learning deep representations with diode loss for quantization-based similarity search

Shicong Liu, Hongtao Lu

Abstract: Recent advance of large scale similarity search involves using deeply learned representations to improve the search accuracy and apply vector quantization techniques to accelerate the search speed. However, simultaneous learning of deep representations and vector quantizers still remains ineffective. To this end, we propose to directly optimize the asymmetric distance between a query representation and the quantized database representations. A novel diode loss is proposed, it wraps a commonly used similarity loss function and then it allows effective end-to-end learning of both deep representations and vector quantizers with a siamese network. The proposed learning framework is compatible with various existing vector quantization approaches, and is compatible with commonly used loss functions for learning representations preserving similarities. Experimental results demonstrate that the proposed framework is effective, flexible and outperforms the state-of-the-art large scale similarity search methods.