Following the Teacher's Footsteps: Scheduled Checkpoint Distillation for Domain-Specific LLMs

Cheng Feng, Chaoliang Zhong, Jun Sun 0004, Yusuke Oishi. Following the Teacher's Footsteps: Scheduled Checkpoint Distillation for Domain-Specific LLMs. In Maria De Marsico, Tin Kam Ho, Frédéric Jurie, Cheng-Lin Liu, Daniel P. Lopresti, Ingela Nyström, Jean-Marc Ogier, Arun Ross, Liang Wang 0001, editors, Pattern Recognition - 28th International Conference, ICPR 2026, Lyon, France, August 17-22, 2026, Proceedings, Part V. Volume 16816 of Lecture Notes in Computer Science, pages 312-327, Springer, 2026. [doi]

Abstract

Abstract is missing.