Investigating Semantic Subspaces of Transformer Sentence Embeddings through Linear Structural Probing

Dmitry Nikolaev 0003, Sebastian Padó. Investigating Semantic Subspaces of Transformer Sentence Embeddings through Linear Structural Probing. In Yonatan Belinkov, Sophie Hao, Jaap Jumelet, Najoung Kim, Arya McCarthy, Hosein Mohebbi, editors, Proceedings of the 6th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP, BlackboxNLP@EMNLP 2023, Singapore, December 7, 2023. pages 142-154, Association for Computational Linguistics, 2023. [doi]

@inproceedings{NikolaevP23-0,
  title = {Investigating Semantic Subspaces of Transformer Sentence Embeddings through Linear Structural Probing},
  author = {Dmitry Nikolaev 0003 and Sebastian Padó},
  year = {2023},
  url = {https://aclanthology.org/2023.blackboxnlp-1.11},
  researchr = {https://researchr.org/publication/NikolaevP23-0},
  cites = {0},
  citedby = {0},
  pages = {142-154},
  booktitle = {Proceedings of the 6th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP, BlackboxNLP@EMNLP 2023, Singapore, December 7, 2023},
  editor = {Yonatan Belinkov and Sophie Hao and Jaap Jumelet and Najoung Kim and Arya McCarthy and Hosein Mohebbi},
  publisher = {Association for Computational Linguistics},
  isbn = {979-8-89176-052-3},
}