Direction is what you need: Improving Word Embedding Compression in Large Language Models

Klaudia Balazy, Mohammadreza Banaei, Rémi Lebret, Jacek Tabor, Karl Aberer