On Attention Redundancy: A Comprehensive Study

Yuchen Bian, Jiaji Huang, Xingyu Cai, Jiahong Yuan, Kenneth Church 0001. On Attention Redundancy: A Comprehensive Study. In Kristina Toutanova, Anna Rumshisky, Luke Zettlemoyer, Dilek Hakkani-Tür, Iz Beltagy, Steven Bethard, Ryan Cotterell, Tanmoy Chakraborty 0002, Yichao Zhou, editors, Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2021, Online, June 6-11, 2021. pages 930-945, Association for Computational Linguistics, 2021. [doi]

Authors

Yuchen Bian

This author has not been identified. Look up 'Yuchen Bian' in Google

Jiaji Huang

This author has not been identified. Look up 'Jiaji Huang' in Google

Xingyu Cai

This author has not been identified. Look up 'Xingyu Cai' in Google

Jiahong Yuan

This author has not been identified. Look up 'Jiahong Yuan' in Google

Kenneth Church 0001

This author has not been identified. Look up 'Kenneth Church 0001' in Google