SHAQ: Single Headed Attention with Quasi-recurrence

Sangeet Dandona, Warren Kushner, Nashwin Bharwani, Ben Schreiber 0002. SHAQ: Single Headed Attention with Quasi-recurrence. In Kohei Arai, editor, Intelligent Computing - Proceedings of the 2022 Computing Conference, Volume 2, SAI 2022, Virtual Event, 14-15 July 2022. Volume 507 of Lecture Notes in Networks and Systems, pages 548-563, Springer, 2022. [doi]

Abstract

Abstract is missing.