Investigating Semantic Subspaces of Transformer Sentence Embeddings through Linear Structural Probing

Dmitry Nikolaev 0003, Sebastian Padó. Investigating Semantic Subspaces of Transformer Sentence Embeddings through Linear Structural Probing. In Yonatan Belinkov, Sophie Hao, Jaap Jumelet, Najoung Kim, Arya McCarthy, Hosein Mohebbi, editors, Proceedings of the 6th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP, BlackboxNLP@EMNLP 2023, Singapore, December 7, 2023. pages 142-154, Association for Computational Linguistics, 2023. [doi]

Abstract

Abstract is missing.