Finetuning Pretrained Transformers into RNNs

Jungo Kasai, Hao Peng, Yizhe Zhang, Dani Yogatama, Gabriel Ilharco, Nikolaos Pappas 0002, Yi Mao, Weizhu Chen, Noah A. Smith. Finetuning Pretrained Transformers into RNNs. In Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih, editors, Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta Cana, Dominican Republic, 7-11 November, 2021. pages 10630-10643, Association for Computational Linguistics, 2021. [doi]

Abstract

Abstract is missing.