Simple Parameter-free Self-attention Approximation

Yuwen Zhai, Jing Hao, Liang Gao 0001, Xinyu Li 0001, Yiping Gao, Shumin Han. Simple Parameter-free Self-attention Approximation. In Krystal Maughan, Rosanne Liu, Thomas F. Burns, editors, The First Tiny Papers Track at ICLR 2023, Tiny Papers @ ICLR 2023, Kigali, Rwanda, May 5, 2023. OpenReview.net, 2023. [doi]

Abstract

Abstract is missing.