SMASH: Improving SMAll Language Models' Few-SHot Ability with Prompt-Based Distillation

Yueqian Wang, Chang Liu, Kai Chen, Xi Wang, Dongyan Zhao 0001. SMASH: Improving SMAll Language Models' Few-SHot Ability with Prompt-Based Distillation. In Yoav Goldberg, Zornitsa Kozareva, Yue Zhang, editors, Findings of the Association for Computational Linguistics: EMNLP 2022, Abu Dhabi, United Arab Emirates, December 7-11, 2022. pages 6608-6619, Association for Computational Linguistics, 2022. [doi]

Abstract

Abstract is missing.