Query-Key Normalization for Transformers

Alex Henry, Prudhvi Raj Dachapally, Shubham Shantaram Pawar, Yuxuan Chen. Query-Key Normalization for Transformers. In Trevor Cohn, Yulan He, Yang Liu, editors, Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings, EMNLP 2020, Online Event, 16-20 November 2020. pages 4246-4253, Association for Computational Linguistics, 2020. [doi]

Abstract

Abstract is missing.