Transformers with Learnable Activation Functions

Haishuo Fang, Ji Ung Lee, Nafise Sadat Moosavi, Iryna Gurevych. Transformers with Learnable Activation Functions. In Andreas Vlachos 0001, Isabelle Augenstein, editors, Findings of the Association for Computational Linguistics: EACL 2023, Dubrovnik, Croatia, May 2-6, 2023. pages 2337-2353, Association for Computational Linguistics, 2023. [doi]

Abstract

Abstract is missing.