Losing Heads in the Lottery: Pruning Transformer Attention in Neural Machine Translation

Maximiliana Behnke, Kenneth Heafield. Losing Heads in the Lottery: Pruning Transformer Attention in Neural Machine Translation. In Bonnie Webber, Trevor Cohn, Yulan He, Yang Liu, editors, Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, November 16-20, 2020. pages 2664-2674, Association for Computational Linguistics, 2020. [doi]

Abstract

Abstract is missing.