Attention Temperature Matters in Abstractive Summarization Distillation

Shengqiang Zhang, Xingxing Zhang, Hangbo Bao, Furu Wei. Attention Temperature Matters in Abstractive Summarization Distillation. In Smaranda Muresan, Preslav Nakov, Aline Villavicencio, editors, Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2022, Dublin, Ireland, May 22-27, 2022. pages 127-141, Association for Computational Linguistics, 2022. [doi]

Abstract

Abstract is missing.