Tiny Attention: A Simple yet Effective Method for Learning Contextual Word Embeddings

Renjith P. Ravindran, Narayana Murthy Kavi. Tiny Attention: A Simple yet Effective Method for Learning Contextual Word Embeddings. In Krystal Maughan, Rosanne Liu, Thomas F. Burns, editors, The First Tiny Papers Track at ICLR 2023, Tiny Papers @ ICLR 2023, Kigali, Rwanda, May 5, 2023. OpenReview.net, 2023. [doi]

Abstract

Abstract is missing.