Direction is what you need: Improving Word Embedding Compression in Large Language Models

Klaudia Balazy, Mohammadreza Banaei, Rémi Lebret, Jacek Tabor, Karl Aberer. Direction is what you need: Improving Word Embedding Compression in Large Language Models. In Anna Rogers, Iacer Calixto, Ivan Vulic, Naomi Saphra, Nora Kassner, Oana-Maria Camburu, Trapit Bansal, Vered Shwartz, editors, Proceedings of the 6th Workshop on Representation Learning for NLP, RepL4NLP@ACL-IJCNLP 2021, Online, August 6, 2021. pages 322-330, Association for Computational Linguistics, 2021. [doi]

@inproceedings{BalazyBLTA21,
  title = {Direction is what you need: Improving Word Embedding Compression in Large Language Models},
  author = {Klaudia Balazy and Mohammadreza Banaei and Rémi Lebret and Jacek Tabor and Karl Aberer},
  year = {2021},
  url = {https://aclanthology.org/2021.repl4nlp-1.32},
  researchr = {https://researchr.org/publication/BalazyBLTA21},
  cites = {0},
  citedby = {0},
  pages = {322-330},
  booktitle = {Proceedings of the 6th Workshop on Representation Learning for NLP, RepL4NLP@ACL-IJCNLP 2021, Online, August 6, 2021},
  editor = {Anna Rogers and Iacer Calixto and Ivan Vulic and Naomi Saphra and Nora Kassner and Oana-Maria Camburu and Trapit Bansal and Vered Shwartz},
  publisher = {Association for Computational Linguistics},
  isbn = {978-1-954085-72-5},
}