Why Bother with Geometry? On the Relevance of Linear Decompositions of Transformer Embeddings

Timothee Mickus, Raúl Vázquez. Why Bother with Geometry? On the Relevance of Linear Decompositions of Transformer Embeddings. In Yonatan Belinkov, Sophie Hao, Jaap Jumelet, Najoung Kim, Arya McCarthy, Hosein Mohebbi, editors, Proceedings of the 6th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP, BlackboxNLP@EMNLP 2023, Singapore, December 7, 2023. pages 127-141, Association for Computational Linguistics, 2023. [doi]

@inproceedings{MickusV23,
  title = {Why Bother with Geometry? On the Relevance of Linear Decompositions of Transformer Embeddings},
  author = {Timothee Mickus and Raúl Vázquez},
  year = {2023},
  url = {https://aclanthology.org/2023.blackboxnlp-1.10},
  researchr = {https://researchr.org/publication/MickusV23},
  cites = {0},
  citedby = {0},
  pages = {127-141},
  booktitle = {Proceedings of the 6th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP, BlackboxNLP@EMNLP 2023, Singapore, December 7, 2023},
  editor = {Yonatan Belinkov and Sophie Hao and Jaap Jumelet and Najoung Kim and Arya McCarthy and Hosein Mohebbi},
  publisher = {Association for Computational Linguistics},
  isbn = {979-8-89176-052-3},
}