Open Peer Review. Open Publishing. Open Access. Open Discussion. Open Directory. Open Recommendations. Open API. Open Source.
SpectralWords: Spectral Embeddings Approach to Word Similarity Task for Large Vocabularies
Feb 12, 2018 (modified: Jun 04, 2018)ICLR 2018 Workshop Submissionreaders: everyoneShow Bibtex
Abstract:In this paper we show how recent advances in spectral clustering using Bethe Hessian operator can be used to learn dense word representations. We propose an algorithm SpectralWords that achieves comparable to the state-of-the-art performance on word similarity tasks for medium-size vocabularies and can be superior for datasets with larger vocabularies.
Keywords:spectral clustering, distributed representation, embeddings, word similarities
TL;DR:Beating Skip-gram and SVD (on PPMI) on word similarity tasks with large vocabularies by using spectral-based approach.
Enter your feedback below and we'll get back to you as soon as possible.