On Isotropy Calibration of Transformer Models

Yue Ding, Karolis Martinkus, Damian Pascual, Simon Clematide, Roger Wattenhofer. On Isotropy Calibration of Transformer Models. In Shabnam Tafreshi, João Sedoc, Anna Rogers, Aleksandr Drozd, Anna Rumshisky, Arjun R. Akula, editors, Proceedings of the Third Workshop on Insights from Negative Results in NLP, Insights@ACL 2022, Dublin, Ireland, May 26, 2022. pages 1-9, Association for Computational Linguistics, 2022. [doi]

Abstract

Abstract is missing.