Zeyu Yun, Yubei Chen, Bruno A. Olshausen, Yann LeCun. Transformer visualization via dictionary learning: contextualized embedding as a linear superposition of transformer factors. In Eneko Agirre, Marianna Apidianaki, Ivan Vulic, editors, Proceedings of Deep Learning Inside Out: The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures, DeeLIO@NAACL-HLT 2021, Online, June 10 2021. pages 1-10, Association for Computational Linguistics, 2021. [doi]
Abstract is missing.