Transformers with Learnable Activation Functions

Haishuo Fang, Ji Ung Lee, Nafise Sadat Moosavi, Iryna Gurevych. Transformers with Learnable Activation Functions. In Andreas Vlachos 0001, Isabelle Augenstein, editors, Findings of the Association for Computational Linguistics: EACL 2023, Dubrovnik, Croatia, May 2-6, 2023. pages 2337-2353, Association for Computational Linguistics, 2023. [doi]

@inproceedings{FangLMG23,
  title = {Transformers with Learnable Activation Functions},
  author = {Haishuo Fang and Ji Ung Lee and Nafise Sadat Moosavi and Iryna Gurevych},
  year = {2023},
  url = {https://aclanthology.org/2023.findings-eacl.181},
  researchr = {https://researchr.org/publication/FangLMG23},
  cites = {0},
  citedby = {0},
  pages = {2337-2353},
  booktitle = {Findings of the Association for Computational Linguistics: EACL 2023, Dubrovnik, Croatia, May 2-6, 2023},
  editor = {Andreas Vlachos 0001 and Isabelle Augenstein},
  publisher = {Association for Computational Linguistics},
  isbn = {978-1-959429-47-0},
}