Jongwoo Ko, Seungjoon Park, Minchan Jeong, Sukjin Hong, Euijai Ahn, Du-Seong Chang, Se-Young Yun. Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective. In Andreas Vlachos 0001, Isabelle Augenstein, editors, Findings of the Association for Computational Linguistics: EACL 2023, Dubrovnik, Croatia, May 2-6, 2023. pages 158-175, Association for Computational Linguistics, 2023. [doi]
Abstract is missing.