All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality

William Timkey, Marten Van Schijndel. All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality. In Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih, editors, Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta Cana, Dominican Republic, 7-11 November, 2021. pages 4527-4546, Association for Computational Linguistics, 2021. [doi]

Authors

William Timkey

This author has not been identified. Look up 'William Timkey' in Google

Marten Van Schijndel

This author has not been identified. Look up 'Marten Van Schijndel' in Google