An Analysis of Linear Complexity Attention Substitutes With Best-RQ

Ryan Whetten, Titouan Parcollet, Adel Moumen, Marco Dinarelli, Yannick Estève. An Analysis of Linear Complexity Attention Substitutes With Best-RQ. In IEEE Spoken Language Technology Workshop, SLT 2024, Macao, December 2-5, 2024. pages 169-176, IEEE, 2024. [doi]

Abstract

Abstract is missing.