Beyond Answers: Transferring Reasoning Capabilities to Smaller LLMs Using Multi-Teacher Knowledge Distillation

Yijun Tian 0001, Yikun Han, Xiusi Chen, Wei Wang 0010, Nitesh V. Chawla. Beyond Answers: Transferring Reasoning Capabilities to Smaller LLMs Using Multi-Teacher Knowledge Distillation. In Wolfgang Nejdl, Sören Auer, Meeyoung Cha, Marie-Francine Moens, Marc Najork, editors, Proceedings of the Eighteenth ACM International Conference on Web Search and Data Mining, WSDM 2025, Hannover, Germany, March 10-14, 2025. pages 251-260, ACM, 2025. [doi]

Abstract

Abstract is missing.