MiniALBERT: Model Distillation via Parameter-Efficient Recursive Transformers

Mohammadmahdi Nouriborji, Omid Rohanian, Samaneh Kouchaki, David A. Clifton. MiniALBERT: Model Distillation via Parameter-Efficient Recursive Transformers. In Andreas Vlachos 0001, Isabelle Augenstein, editors, Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2023, Dubrovnik, Croatia, May 2-6, 2023. pages 1153-1165, Association for Computational Linguistics, 2023. [doi]

Abstract

Abstract is missing.