Divide-or-Conquer? Which Part Should You Distill Your LLM?

Zhuofeng Wu 0001, Richard He Bai, Aonan Zhang, Jiatao Gu, V. G. Vinod Vydiswaran, Navdeep Jaitly, Yizhe Zhang 0002. Divide-or-Conquer? Which Part Should You Distill Your LLM?. In Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen, editors, Findings of the Association for Computational Linguistics: EMNLP 2024, Miami, Florida, USA, November 12-16, 2024. pages 2572-2585, Association for Computational Linguistics, 2024. [doi]

Abstract

Abstract is missing.