Direction is what you need: Improving Word Embedding Compression in Large Language Models

Klaudia Balazy, Mohammadreza Banaei, Rémi Lebret, Jacek Tabor, Karl Aberer. Direction is what you need: Improving Word Embedding Compression in Large Language Models. In Anna Rogers, Iacer Calixto, Ivan Vulic, Naomi Saphra, Nora Kassner, Oana-Maria Camburu, Trapit Bansal, Vered Shwartz, editors, Proceedings of the 6th Workshop on Representation Learning for NLP, RepL4NLP@ACL-IJCNLP 2021, Online, August 6, 2021. pages 322-330, Association for Computational Linguistics, 2021. [doi]

Authors

Klaudia Balazy

This author has not been identified. Look up 'Klaudia Balazy' in Google

Mohammadreza Banaei

This author has not been identified. Look up 'Mohammadreza Banaei' in Google

Rémi Lebret

This author has not been identified. Look up 'Rémi Lebret' in Google

Jacek Tabor

This author has not been identified. Look up 'Jacek Tabor' in Google

Karl Aberer

This author has not been identified. It may be one of the following persons: Look up 'Karl Aberer' in Google